00000001:02000400:2.0F:1790096570.607142:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1790096589.266762:0:3192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1790096590.991267:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 549 MB/s 00000001:01000000:3.0F:1790096591.241629:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 771 MB/s 00000001:01000000:3.0:1790096591.491923:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7475 MB/s 00000020:02000000:1.0:1790096592.145335:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_gba3a43f 00000400:02000000:2.0:1790096592.958301:0:3298:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.111@tcp [8/256/0/180] 00008000:02000000:2.0:1790096596.456339:0:3448:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790096645.874287:0:5252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790096655.783210:0:5832:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790096655.783221:0:5832:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790096655.783402:0:5832:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006b463527 00000080:02000400:2.0:1790096655.783420:0:5832:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790096655.791170:0:5832:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790096655.791191:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790096655.791250:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000011371ac5) 00000020:00000080:2.0:1790096655.791279:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790096655.824035:0:5832:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790096655.824572:0:5832:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790096655.879372:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790096655.879429:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790096655.879454:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790096655.879510:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790096655.879556:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790096655.880125:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790096655.880137:0:5832:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790096655.880151:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab558d 00000020:01000004:2.0:1790096655.880161:0:5832:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790096655.880172:0:5832:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790096655.880177:0:5832:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b463527 from MGS 00000020:01000004:2.0:1790096655.880182:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790096655.880196:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000787d4518) 00000020:00000080:2.0:1790096655.880209:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790096655.880308:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b463527 from MGS, refs=2 00080000:01000000:2.0:1790096655.880314:0:5832:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790096655.880320:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab559b 00000100:00100000:2.0:1790096655.880437:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790096655.880624:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790096655.880679:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790096655.883628:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790096655.883670:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0F:1790096655.885144:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096655.885408:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790096655.885415:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790096655.897511:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790096655.899733:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790096655.900288:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790096655.900298:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790096655.901474:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096655.901479:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096655.901481:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096655.902123:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096655.902126:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096655.902128:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096655.906882:0:5832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790096655.909113:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1790096656.156705:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1915 MB/s 00000001:01000000:2.0:1790096656.407173:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3107 MB/s 00000001:01000000:2.0:1790096656.658186:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 549 MB/s 00000001:01000000:3.0:1790096656.907698:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 695 MB/s 00080000:10000000:0.0:1790096656.918667:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1790096656.936001:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790096656.936026:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790096656.936029:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790096656.942901:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790096656.944957:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790096656.945043:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1790096656.945380:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790096656.945415:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790096656.946173:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096656.946385:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790096656.946393:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790096656.947673:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790096656.947684:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790096656.948169:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790096656.948176:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790096656.951357:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790096656.951390:0:5832:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:0.0:1790096656.951392:0:5832:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790096656.951459:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:0.0:1790096656.951486:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (0000000096136355) 00000020:00000080:0.0:1790096656.951510:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790096656.952537:0:5832:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003fe41093@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790096656.952788:0:5832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:0.0:1790096656.952796:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790096656.957254:0:5847:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1790096656.962000:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790096656.963847:0:5849:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790096656.963983:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid f3fc9c4a-28d1-48dc-adb2-3db9678ceb85) 00000020:00000080:1.0:1790096656.964022:0:5832:0:(genops.c:1384:class_connect()) connect: client f3fc9c4a-28d1-48dc-adb2-3db9678ceb85, cookie 0xcc97d9eae5ab55a9 00000100:00080000:1.0:1790096656.964039:0:5832:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790096656.964055:0:5832:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import 000000003fe41093 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096656.964144:0:5832:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a005fc4d x1877052324053120/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790096656.964181:0:5832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f3fc9c4a-28d1-48dc-adb2-3db9678ceb85->MGS 00000020:01000004:1.0:1790096656.964216:0:5832:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790096656.964222:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790096656.964251:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e1c0f734) 00000020:00000080:1.0:1790096656.964269:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790096656.966499:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a005fc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3313:1877052324053120:0@lo:250: 00000100:00100000:2.0:1790096656.966837:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096656.978426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053120 00000100:00100000:0.0:1790096656.978450:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053120 00000100:00100000:0.0:1790096656.978517:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096656.978527:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2719a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1877052324053120:12345-0@lo:250: 00010000:00080000:0.0:1790096656.978576:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f3fc9c4a-28d1-48dc-adb2-3db9678ceb85@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1790096656.978652:0:5844:0:(genops.c:1384:class_connect()) connect: client f3fc9c4a-28d1-48dc-adb2-3db9678ceb85, cookie 0xcc97d9eae5ab55b7 00000100:00080000:0.0:1790096656.978885:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000beead9b8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096656.979008:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2719a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:3313:x1877052324053120:12345-0@lo:250: Request processed in 482us (12172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096656.979017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096656.979473:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790096656.979487:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1790096656.979497:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790096656.979503:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790096656.979508:0:3313:0:(import.c:65:import_set_state_nolock()) 000000003fe41093 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790096656.979511:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790096656.979525:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790096656.979530:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a005fc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3313:1877052324053120:0@lo:250: 00000100:00100000:1.0:1790096656.993268:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096656.993531:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790096656.993539:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790096656.998089:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790096656.998126:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790096656.998900:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790096656.998908:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790096656.999865:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096657.000106:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790096657.000119:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790096657.001196:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790096657.001207:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790096657.057584:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096657.057897:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790096657.057905:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790096657.060107:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790096657.060125:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790096657.061365:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096657.062014:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790096657.062022:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790096657.062884:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790096657.062959:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790096657.064216:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096657.064431:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790096657.064438:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790096657.065478:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790096657.065488:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790096657.066526:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096657.067059:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790096657.067066:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790096657.068080:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790096657.068090:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790096657.100443:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096657.101047:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790096657.101057:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790096657.104401:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790096657.104422:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790096657.110289:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790096657.110315:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790096657.112005:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790096657.112037:0:5832:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790096657.112046:0:5832:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790096657.112249:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790096657.112297:0:5832:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790096657.112302:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790096657.112303:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790096657.112305:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096657.112306:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096657.112307:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096657.112308:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096657.112310:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790096657.112311:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790096657.112313:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790096657.112314:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790096657.112316:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096657.112317:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096657.112320:0:5832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790096657.112323:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096657.112324:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790096657.112326:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096657.112327:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096657.112328:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096657.112329:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096657.112330:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790096657.112331:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790096657.112338:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790096657.112339:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790096657.112340:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096657.112340:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096657.112399:0:5832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790096657.112420:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003300fd98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053248:0@lo:253: 00000100:00100000:3.0:1790096657.112970:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096657.113066:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026ae58ac going to sleep for 11 seconds 00000100:00100000:0.0:1790096657.113173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053248 00000100:00100000:0.0:1790096657.113185:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053248 00000100:00100000:0.0:1790096657.113303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096657.113313:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000038ab6fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:5832:x1877052324053248:12345-0@lo:253: 20000000:01000000:0.0:1790096657.113377:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790096657.113386:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1790096657.114194:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790096657.114312:0:5846:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790096657.115036:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790096657.116479:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790096657.120011:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790096657.120021:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790096657.120029:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790096657.120034:0:5846:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790096657.120055:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790096657.120404:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096657.121062:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790096657.121084:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790096657.121187:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790096657.121243:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790096657.121285:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790096657.121407:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790096657.121416:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790096657.121460:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790096657.121468:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790096657.121499:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790096657.121506:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790096657.121537:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790096657.121978:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790096657.122023:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790096657.122029:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790096657.122042:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096657.122286:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790096657.122298:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790096657.122340:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790096657.122379:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790096657.122458:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790096657.122473:0:5846:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790096657.123110:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790096657.123125:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790096657.123222:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790096657.123263:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790096657.123297:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790096657.123311:0:5846:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790096657.123417:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790096657.123426:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790096657.123458:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790096657.123494:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790096657.124237:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790096657.124295:0:5846:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790096657.124305:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790096657.126084:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790096657.126902:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790096657.126938:0:5846:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1790096657.126941:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790096657.126979:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790096657.126985:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790096657.127009:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790096657.127015:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790096657.127051:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790096657.127060:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790096657.127085:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790096657.127128:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790096657.127205:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790096657.127209:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790096657.127214:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790096657.127238:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790096657.127241:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790096657.127273:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790096657.127275:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790096657.128576:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1790096657.128899:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790096657.128947:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1790096657.129054:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1790096657.129068:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790096657.129070:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790096657.130148:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790096657.130695:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790096657.130748:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790096657.130781:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1790096657.130800:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790096657.130802:0:5846:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1790096657.130808:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790096657.130811:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790096657.130818:0:5846:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790096657.130827:0:5846:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790096657.132243:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1790096657.132441:0:5846:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790096657.147207:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1790096657.147269:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1790096657.147364:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1790096657.147392:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790096657.147420:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147441:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147453:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147461:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147476:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147483:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2e0ef69 already unused, calling callback (0000000018c6a563) 00010000:00010000:1.0:1790096657.147488:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147496:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.147587:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.148069:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.148078:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790096657.148113:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790096657.488590:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000038ab6fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:5832:x1877052324053248:12345-0@lo:253: Request processed in 375267us (375610us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096657.488614:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096657.488877:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003300fd98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053248:0@lo:253: 10000000:01000000:0.0:1790096657.488896:0:5832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790096657.489019:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096657.489022:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790096657.489023:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096657.489024:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790096657.489026:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096657.489028:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096657.489029:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790096657.489031:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790096657.489032:0:5832:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790096657.489033:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096657.489035:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790096657.489159:0:5832:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b463527 from lustre-MDT0000 10000000:01000000:2.0:1790096657.489197:0:5832:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790096657.489200:0:5832:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790096657.489207:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eaac97d4d40 10000000:01000000:2.0:1790096657.489213:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790096657.489223:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eaac97d4d40 from 1 10000000:01000000:2.0:1790096657.489228:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790096657.489305:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.489324:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.489335:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096657.489356:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053376:0@lo:101: 00000100:00100000:2.0:1790096657.489408:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.489515:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:1.0:1790096657.489631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053376 00000100:00100000:1.0:1790096657.489727:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053376 00000100:00100000:1.0:1790096657.489823:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790096657.489833:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000718b1376 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:5832:x1877052324053376:12345-0@lo:101: 00010000:00010000:1.0:1790096657.489851:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096657.489869:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab55c5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.489896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.489916:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2e0ef69/0xcc97d9eae5ab55cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096657.489926:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2e0ef69, rc 0) 00000100:00100000:1.0:1790096657.490123:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000718b1376 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5832:x1877052324053376:12345-0@lo:101: Request processed in 291us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096657.490130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096657.490210:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053376:0@lo:101: 00010000:00010000:2.0:1790096657.490227:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.490236:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096657.490295:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053504:0@lo:501: 00000100:00100000:2.0:1790096657.490328:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.490421:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:0.0:1790096657.490512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053504 00000100:00100000:0.0:1790096657.490518:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053504 00000100:00100000:0.0:1790096657.490543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096657.490548:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d61fdb25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5832:x1877052324053504:12345-0@lo:501: 00000100:00100000:0.0:1790096657.490885:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d61fdb25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5832:x1877052324053504:12345-0@lo:501: Request processed in 336us (557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096657.490893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096657.491184:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053504:0@lo:501: 10000000:01000000:2.0:1790096657.491228:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790096657.491249:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.491260:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000f62af053/0xcc97d9eae5ab55c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096657.491284:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eaac41f3800 10000000:01000000:2.0:1790096657.491289:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790096657.491294:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9eaac41f3800 10000000:01000000:2.0:1790096657.491296:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790096657.491299:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9eaac41f3800 from 1 10000000:01000000:2.0:1790096657.491301:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790096657.491330:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.491338:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.491347:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096657.491360:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053632:0@lo:101: 00000100:00100000:2.0:1790096657.491398:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.491432:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:0.0:1790096657.491521:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053632 00000100:00100000:0.0:1790096657.491528:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053632 00000100:00100000:0.0:1790096657.491558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790096657.491564:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc370bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5832:x1877052324053632:12345-0@lo:101: 00010000:00010000:0.0:1790096657.491574:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096657.491591:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fa058f6/0xcc97d9eae5ab55da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab55d3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.491623:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fa058f6/0xcc97d9eae5ab55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55d3 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.491725:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fa058f6/0xcc97d9eae5ab55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55d3 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.491736:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fa058f6, rc 0) 00000100:00100000:0.0:1790096657.491783:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc370bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:5832:x1877052324053632:12345-0@lo:101: Request processed in 218us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096657.491789:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096657.491875:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053632:0@lo:101: 00010000:00010000:2.0:1790096657.491887:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.491896:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096657.491922:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790096657.491933:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.491950:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000005f828e8e/0xcc97d9eae5ab55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096657.491956:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790096657.491959:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790096657.492106:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9eaac41f3800 10000000:01000000:2.0:1790096657.492110:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790096657.492114:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790096657.492116:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790096657.492137:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.492144:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.492151:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096657.492164:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053760:0@lo:101: 00000100:00100000:2.0:1790096657.492197:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.492219:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:0.0:1790096657.492289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053760 00000100:00100000:0.0:1790096657.492294:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053760 00000100:00100000:0.0:1790096657.492318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790096657.492324:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da121351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:5832:x1877052324053760:12345-0@lo:101: 00010000:00010000:0.0:1790096657.492332:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096657.492340:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003492d47b/0xcc97d9eae5ab55e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab55e1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.492355:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003492d47b/0xcc97d9eae5ab55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.492363:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003492d47b/0xcc97d9eae5ab55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096657.492369:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003492d47b, rc 0) 00000100:00100000:0.0:1790096657.492411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da121351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+8:5832:x1877052324053760:12345-0@lo:101: Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096657.492416:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096657.492556:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053760:0@lo:101: 00010000:00010000:2.0:1790096657.492568:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096657.492575:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096657.492666:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053888:0@lo:501: 00000100:00100000:2.0:1790096657.492696:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.492707:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:0.0:1790096657.492771:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324053888 00000100:00100000:0.0:1790096657.492775:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324053888 00000100:00100000:0.0:1790096657.492793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096657.492798:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001cc32569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+8:5832:x1877052324053888:12345-0@lo:501: 00000100:00100000:0.0:1790096657.493135:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001cc32569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5832:x1877052324053888:12345-0@lo:501: Request processed in 335us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096657.493142:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096657.493329:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324053888:0@lo:501: 00000100:00100000:2.0:1790096657.493361:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054016:0@lo:503: 00000100:00100000:2.0:1790096657.493396:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096657.493425:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7369acb going to sleep for 11 seconds 00000100:00100000:1.0:1790096657.493558:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054016 00000100:00100000:1.0:1790096657.493565:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054016 00000100:00100000:1.0:1790096657.493593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790096657.493598:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c7f375d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5832:x1877052324054016:12345-0@lo:503: 00000100:00100000:1.0:1790096657.493788:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c7f375d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5832:x1877052324054016:12345-0@lo:503: Request processed in 189us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096657.493794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096657.493928:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054016:0@lo:503: 00000100:00100000:0.0:1790096657.494465:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd231445 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5875:1877052324054144:0@lo:502: 00000100:00100000:0.0:1790096657.494507:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096657.494540:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd882c1c going to sleep for 11 seconds 00000100:00100000:1.0:1790096657.494584:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054144 00000100:00100000:1.0:1790096657.494589:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054144 00000100:00100000:1.0:1790096657.494619:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790096657.494624:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b93da6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5875:x1877052324054144:12345-0@lo:502: 00000100:00100000:1.0:1790096657.494830:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b93da6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5875:x1877052324054144:12345-0@lo:502: Request processed in 205us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096657.494836:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790096657.495069:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd231445 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5875:1877052324054144:0@lo:502: 00000020:01000000:2.0:1790096657.495106:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096657.495120:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096657.495122:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790096657.495128:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790096657.495132:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790096657.495148:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b3d36daf) 00000020:00000080:2.0:1790096657.495170:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790096657.495175:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790096657.495254:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790096657.495260:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab55f6 00000020:00000080:2.0:1790096657.495523:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790096657.495528:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096657.495532:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096657.495533:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790096657.495535:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096657.495538:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096657.495539:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790096657.495542:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790096657.495553:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000015bc7da0) 00000020:00000080:2.0:1790096657.495563:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790096657.495566:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790096657.495568:0:5875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790096657.495571:0:5875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790096657.495576:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790096657.495619:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b463527 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790096657.495683:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007b2cb9c6) 00000020:00000080:2.0:1790096657.495692:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790096657.495765:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790096657.495770:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab560b 00000020:00000080:2.0:1790096657.495872:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790096657.495877:0:5875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790096657.495881:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc97d9eae5ab5612 00080000:01000000:2.0:1790096657.495885:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790096657.495888:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab5619 00080000:10000000:2.0:1790096657.496540:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790096657.497149:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790096657.502783:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1790096657.646996:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1790096657.648879:0:5875:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790096657.653053:0:5875:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790096657.653470:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790096657.712351:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006b26f637) 00000020:00000080:3.0:1790096657.712386:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790096657.712536:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790096657.712544:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab5627 00000020:00000080:3.0:1790096657.712877:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1790096657.714461:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790096657.763575:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790096657.837385:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096657.950954:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:3.0:1790096657.983812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1790096658.058137:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096658.132725:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790096658.182589:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc97d9eae5ab562e 00000020:00000080:2.0:1790096658.183741:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790096658.183757:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096658.183766:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096658.183769:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790096658.183772:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096658.183777:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096658.183778:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790096658.183781:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790096658.183783:0:5875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790096658.183792:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096658.183794:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096658.183796:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790096658.183798:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096658.183803:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096658.183804:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790096658.183809:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790096658.183859:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1790096658.183927:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5875:1877052324054272:0@lo:502: 00000100:00100000:2.0:1790096658.184250:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.184386:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 000000002587c4ce going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.184460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054272 00000100:00100000:1.0:1790096658.184470:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054272 00000100:00100000:1.0:1790096658.184525:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790096658.184534:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ff75654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5875:x1877052324054272:12345-0@lo:502: 00000100:00100000:1.0:1790096658.184974:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ff75654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5875:x1877052324054272:12345-0@lo:502: Request processed in 440us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.184984:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096658.185165:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5875:1877052324054272:0@lo:502: 00000020:01000000:2.0:1790096658.185203:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096658.185209:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096658.185212:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1790096658.185215:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790096658.185797:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790096658.185825:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790096658.185892:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.185905:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000006653ba85/0xcc97d9eae5ab55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096658.185914:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eaac41f3800 from 1 10000000:01000000:3.0:1790096658.185917:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790096658.185970:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.185979:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.185996:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096658.186033:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052b81cac pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054400:0@lo:101: 00000100:00100000:3.0:1790096658.186248:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096658.186292:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe9bc7b6 going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.186363:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054400 00000100:00100000:1.0:1790096658.186370:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054400 00000100:00100000:1.0:1790096658.186418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790096658.186426:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d216d4d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:5832:x1877052324054400:12345-0@lo:101: 00010000:00010000:1.0:1790096658.186439:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096658.186455:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5635 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.186482:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.186507:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.186517:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000971b66a3, rc 0) 00000100:00100000:1.0:1790096658.186576:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d216d4d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:5832:x1877052324054400:12345-0@lo:101: Request processed in 151us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.186582:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790096658.186805:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052b81cac pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054400:0@lo:101: 00010000:00010000:3.0:1790096658.186821:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.186829:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096658.187607:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052b81cac pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054528:0@lo:256: 00000100:00100000:3.0:1790096658.187720:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096658.187753:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe9bc7b6 going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.187870:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054528 00000100:00100000:1.0:1790096658.187877:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054528 00000100:00100000:1.0:1790096658.187925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790096658.187932:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094741351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:5832:x1877052324054528:12345-0@lo:256: 20000000:01000000:1.0:1790096658.187953:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790096658.187969:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790096658.188217:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094741351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:5832:x1877052324054528:12345-0@lo:256: Request processed in 285us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.188225:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096658.188307:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052b81cac pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054528:0@lo:256: 10000000:01000000:2.0:1790096658.188947:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790096658.189352:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.189367:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096658.189375:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac41f3800 from 1 10000000:01000000:2.0:1790096658.189378:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790096658.189421:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.189429:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.189451:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096658.189470:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054656:0@lo:101: 00000100:00100000:2.0:1790096658.189528:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.189575:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000002587c4ce going to sleep for 11 seconds 00000100:00100000:3.0:1790096658.189662:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054656 00000100:00100000:3.0:1790096658.189671:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054656 00000100:00100000:3.0:1790096658.189714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790096658.189721:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072444227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:5832:x1877052324054656:12345-0@lo:101: 00010000:00010000:3.0:1790096658.189733:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096658.189749:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5643 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.189774:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.189784:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.189794:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b2f5622, rc 0) 00000100:00100000:3.0:1790096658.189830:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072444227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324054656:12345-0@lo:101: Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096658.189836:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096658.190187:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054656:0@lo:101: 00010000:00010000:2.0:1790096658.190203:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.190212:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096658.190274:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054784:0@lo:501: 00000100:00100000:2.0:1790096658.190303:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.190375:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000002587c4ce going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.190496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054784 00000100:00100000:1.0:1790096658.190502:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054784 00000100:00100000:1.0:1790096658.190566:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790096658.190573:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072259a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324054784:12345-0@lo:501: 00000100:00100000:1.0:1790096658.191513:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072259a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324054784:12345-0@lo:501: Request processed in 937us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.191523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790096658.191841:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054784:0@lo:501: 00000100:00100000:2.0:1790096658.191890:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054912:0@lo:503: 00000100:00100000:2.0:1790096658.191943:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.193531:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000002587c4ce going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.194623:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324054912 00000100:00100000:1.0:1790096658.194649:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324054912 00000100:00100000:1.0:1790096658.194777:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790096658.194787:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ef73e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324054912:12345-0@lo:503: 00000040:00080000:1.0:1790096658.194884:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790096658.195070:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ef73e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324054912:12345-0@lo:503: Request processed in 284us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.195095:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096658.195421:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bc67b09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324054912:0@lo:503: 00000040:00080000:2.0:1790096658.196790:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790096658.197488:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790096658.197584:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096658.199837:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.199862:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096658.199946:0:5832:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790096658.199950:0:5832:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eaac41f3800 10000000:01000000:0.0:1790096658.199953:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eaac41f3800 10000000:01000000:0.0:1790096658.199970:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790096658.199978:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac41f3800 from 1 10000000:01000000:0.0:1790096658.200206:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790096658.200373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.200384:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.200398:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096658.200425:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055040:0@lo:101: 00000100:00100000:1.0:1790096658.200519:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096658.200617:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000705255a8 going to sleep for 11 seconds 00000100:00100000:2.0:1790096658.200880:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055040 00000100:00100000:2.0:1790096658.200891:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055040 00000100:00100000:2.0:1790096658.201001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096658.201010:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000648bae43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324055040:12345-0@lo:101: 00010000:00010000:2.0:1790096658.201027:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096658.201051:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b941d10/0xcc97d9eae5ab5658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5651 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.201098:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b941d10/0xcc97d9eae5ab5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.201109:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b941d10/0xcc97d9eae5ab5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.201118:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b941d10, rc 0) 00000100:00100000:2.0:1790096658.201172:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000648bae43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055040:12345-0@lo:101: Request processed in 163us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096658.201178:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790096658.201270:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055040:0@lo:101: 00010000:00010000:1.0:1790096658.201285:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.201293:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096658.201349:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055168:0@lo:501: 00000100:00100000:1.0:1790096658.201376:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096658.201825:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000705255a8 going to sleep for 11 seconds 00000100:00100000:3.0:1790096658.201928:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055168 00000100:00100000:3.0:1790096658.201935:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055168 00000100:00100000:3.0:1790096658.202141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790096658.202149:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f9d7049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055168:12345-0@lo:501: 00000100:00100000:3.0:1790096658.202610:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f9d7049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055168:12345-0@lo:501: Request processed in 462us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096658.202619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790096658.202833:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055168:0@lo:501: 00000100:00100000:1.0:1790096658.202882:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055296:0@lo:503: 00000100:00100000:1.0:1790096658.202938:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096658.202975:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000705255a8 going to sleep for 11 seconds 00000100:00100000:3.0:1790096658.203216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055296 00000100:00100000:3.0:1790096658.203228:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055296 00000100:00100000:3.0:1790096658.203267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790096658.203273:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6948280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055296:12345-0@lo:503: 00000100:00100000:3.0:1790096658.203796:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6948280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055296:12345-0@lo:503: Request processed in 521us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096658.203804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790096658.203949:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055296:0@lo:503: 00000100:00100000:2.0:1790096658.205495:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd14c377 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5880:1877052324055424:0@lo:502: 00000100:00100000:2.0:1790096658.205774:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.205873:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059df71db going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.205913:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055424 00000100:00100000:1.0:1790096658.205922:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055424 00000100:00100000:1.0:1790096658.206186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790096658.206206:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7e432f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5880:x1877052324055424:12345-0@lo:502: 00000100:00100000:1.0:1790096658.208412:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7e432f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5880:x1877052324055424:12345-0@lo:502: Request processed in 2207us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096658.208429:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790096658.209015:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd14c377 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5880:1877052324055424:0@lo:502: 00000020:01000004:2.0:1790096658.209407:0:5880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790096658.209431:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f9531573) 00000020:00000080:2.0:1790096658.209456:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1790096658.212272:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b463527 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790096658.212287:0:5880:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006b463527 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790096658.212291:0:5880:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006b463527 4 00010000:00080000:3.0:1790096658.212341:0:5880:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b5a73527@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790096658.218620:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790096658.219039:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790096658.219161:0:5880:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790096658.219179:0:5880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc97d9eae5ab5666 00000100:00080000:2.0:1790096658.219194:0:5880:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790096658.219208:0:5880:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b5a73527 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096658.219255:0:5880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bd14c377 x1877052324055552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096658.219357:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd14c377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324055552:0@lo:38: 00000100:00100000:3.0:1790096658.219444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096658.219584:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055552 00000100:00100000:0.0:1790096658.219595:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055552 00000100:00100000:0.0:1790096658.219656:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096658.219663:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000909ebfeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324055552:12345-0@lo:38: 00000100:00080000:2.0:1790096658.219753:0:5880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790096658.221864:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f079aef7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5880:1877052324055680:0@lo:502: 00000100:00100000:2.0:1790096658.221978:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.222025:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0bb97b4 going to sleep for 11 seconds 00000100:00100000:0.0:1790096658.227140:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000909ebfeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324055552:12345-0@lo:38: Request processed in 7466us (7685us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790096658.227160:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096658.227217:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055680 00000100:00100000:0.0:1790096658.227229:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055680 00000100:00100000:0.0:1790096658.227282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790096658.227290:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f29a80d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5880:x1877052324055680:12345-0@lo:502: 00000100:00100000:0.0:1790096658.227662:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f29a80d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5880:x1877052324055680:12345-0@lo:502: Request processed in 344us (5656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096658.227670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790096658.227758:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f079aef7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5880:1877052324055680:0@lo:502: 00000040:00080000:0.0:1790096658.227800:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790096658.229299:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790096658.229337:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790096658.229364:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096658.229379:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000067830f2/0xcc97d9eae5ab5651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790096658.229446:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790096658.229449:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790096658.229450:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096658.229451:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790096658.229453:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096658.229454:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096658.229455:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790096658.229457:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790096658.229458:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790096658.229460:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790096658.229461:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096658.229463:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790096658.229467:0:5832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790096658.229470:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790096658.229477:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790096658.229478:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096658.229479:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790096658.229479:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096658.229480:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096658.229481:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790096658.229482:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790096658.229483:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790096658.229484:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790096658.229485:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096658.229485:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790096658.229525:0:5832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790096658.229544:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055808:0@lo:253: 00000100:00100000:1.0:1790096658.229622:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096658.229702:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bae5251d going to sleep for 11 seconds 00000100:00100000:1.0:1790096658.229727:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055808 00000100:00100000:1.0:1790096658.229735:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055808 00000100:00100000:1.0:1790096658.229780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790096658.229788:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b433a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5832:x1877052324055808:12345-0@lo:253: 20000000:01000000:1.0:1790096658.229821:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790096658.229839:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790096658.233186:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790096658.233204:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000b5a73527 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790096658.233214:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790096658.233218:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd14c377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324055552:0@lo:38: 20000000:01000000:2.0:1790096658.290368:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790096658.290432:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790096658.293459:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790096658.293474:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790096658.293764:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.293792:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.293802:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.293858:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096658.293875:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 12 pid: 5846 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096658.293890:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003118e16 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324055936:0@lo:104: 00000100:00100000:3.0:1790096658.294010:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096658.294331:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ae30654 going to sleep for 11 seconds 00000100:00100000:0.0:1790096658.294474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324055936 00000100:00100000:0.0:1790096658.294485:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324055936 00000100:00100000:0.0:1790096658.294567:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096658.294577:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091b2d4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324055936:12345-0@lo:104: 00010000:00010000:0.0:1790096658.294592:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294681:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096658.294687:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091b2d4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324055936:12345-0@lo:104: Request processed in 112us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096658.294695:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096658.294751:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003118e16 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324055936:0@lo:104: 00010000:00010000:0.0:1790096658.294772:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294792:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096658.294797:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294805:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e4936b8 already unused, calling callback (00000000a12d8bb3) 10000000:00010000:0.0:1790096658.294808:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294816:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096658.294822:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096658.294827:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096658.294860:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294867:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096658.294885:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294890:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000006e4936b8/0xcc97d9eae5ab5635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab563c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096658.294910:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096658.294912:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096658.294919:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096658.295454:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ac61586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324056064:0@lo:103: 00000100:00100000:2.0:1790096658.295603:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096658.301197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056064 00000100:00100000:2.0:1790096658.301223:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056064 00010000:00010000:2.0:1790096658.301275:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 13 pid: 5846 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096658.301371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096658.301381:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd14c377 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3315:x1877052324056064:12345-0@lo:103: 00010000:00010000:2.0:1790096658.301399:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096658.301404:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 13 pid: 5846 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301417:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 13 pid: 5846 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301439:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000971b66a3/0xcc97d9eae5ab563c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5635 expref: 13 pid: 5846 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301481:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301490:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790096658.301512:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008038926s 00010000:00010000:2.0:1790096658.301516:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301523:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301530:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301537:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301544:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ced4622e already unused, calling callback (0000000018c6a563) 00010000:00010000:2.0:1790096658.301548:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301557:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301573:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.301585:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096658.301695:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd14c377 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324056064:12345-0@lo:103: Request processed in 316us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096658.301703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096658.302305:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ac61586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324056064:0@lo:103: 00010000:00010000:2.0:1790096658.302345:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.302353:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096658.302359:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ced4622e/0xcc97d9eae5ab566d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096658.306496:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b433a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5832:x1877052324055808:12345-0@lo:253: Request processed in 76699us (76865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096658.306520:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790096658.306672:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314b98b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5832:1877052324055808:0@lo:253: 10000000:01000000:1.0:1790096658.306692:0:5832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790096658.306696:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790096658.306698:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790096658.306700:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096658.306701:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790096658.306703:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096658.306704:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096658.306705:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790096658.306707:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790096658.306708:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790096658.306710:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790096658.306712:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096658.306713:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790096658.306732:0:5832:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790096658.313867:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096658.314300:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790096658.314516:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096658.314746:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790096658.314953:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096658.318191:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096658.322446:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096658.322745:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096658.323226:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096658.323410:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096658.323628:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096658.323843:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790096658.375328:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790096658.430795:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1790096658.431150:0:5886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1790096658.433047:0:5885:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790096658.433054:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790096658.436024:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790096658.436262:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790096658.437030:0:5832:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790096658.437043:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790096658.437250:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096658.438583:0:5832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790096658.439507:0:5832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790096658.439554:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790096658.440210:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790096658.440464:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1790096658.442384:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790096658.442548:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790096658.443107:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790096658.443272:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790096658.443429:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790096658.443569:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790096658.452424:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790096658.454484:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790096658.454839:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790096658.455275:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790096658.455441:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790096658.455744:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790096658.459066:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790096658.461545:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790096658.461779:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790096658.466179:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790096658.467357:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790096658.467549:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790096658.467731:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790096658.468190:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790096658.468370:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790096658.468516:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790096658.468839:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790096658.469298:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790096658.469583:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790096658.469753:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790096658.470264:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790096658.470425:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790096658.470585:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790096658.470775:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790096658.471198:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790096658.471366:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790096658.471719:0:5832:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1790096658.486207:0:5886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1790096658.541451:0:5832:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790096658.541501:0:5832:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9f41c23988 00100000:10000000:0.0:1790096658.541512:0:5832:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790096658.544625:0:5832:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790096658.544666:0:5832:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790096658.544684:0:5832:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790096658.544706:0:5832:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1790096658.597180:0:5886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790096658.597302:0:5886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790096658.597308:0:5886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790096659.007063:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096660.028822:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096661.053191:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096662.077126:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790096662.908703:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790096662.908729:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eaac41f3800 from 3 10000000:01000000:0.0:1790096662.908737:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790096662.908803:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096662.908818:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096662.908832:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096662.908862:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bba858e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324056192:0@lo:101: 00000100:00100000:0.0:1790096662.908963:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096662.909105:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ef23e12 going to sleep for 11 seconds 00000100:00100000:1.0:1790096662.911624:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056192 00000100:00100000:1.0:1790096662.911654:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056192 00000100:00100000:1.0:1790096662.911742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790096662.911963:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ff1f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5849:x1877052324056192:12345-0@lo:101: 00010000:00010000:1.0:1790096662.911994:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096662.912022:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a39cd9ad/0xcc97d9eae5ab567b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5674 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096662.912071:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a39cd9ad/0xcc97d9eae5ab567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096662.912084:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a39cd9ad/0xcc97d9eae5ab567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096662.912094:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a39cd9ad, rc 0) 00000100:00100000:1.0:1790096662.912289:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ff1f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324056192:12345-0@lo:101: Request processed in 537us (3327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096662.912297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790096662.912503:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bba858e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324056192:0@lo:101: 00010000:00010000:0.0:1790096662.912529:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096662.912540:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096662.912628:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bba858e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324056320:0@lo:256: 00000100:00100000:0.0:1790096662.912704:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096662.912747:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ef23e12 going to sleep for 11 seconds 00000100:00100000:1.0:1790096662.912881:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056320 00000100:00100000:1.0:1790096662.912901:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056320 00000100:00100000:1.0:1790096662.912934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790096662.912949:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002370e808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324056320:12345-0@lo:256: 20000000:01000000:1.0:1790096662.912968:0:5846:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790096662.912989:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790096662.912992:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790096662.913101:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002370e808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324056320:12345-0@lo:256: Request processed in 153us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096662.913109:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790096662.913142:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bba858e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324056320:0@lo:256: 10000000:01000000:1.0:1790096662.913205:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790096662.913214:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096662.913224:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000001dc9f15f/0xcc97d9eae5ab5674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096663.105158:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096663.342524:0:6129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790096663.420811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790096663.420824:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790096663.420828:0:8:0:(import.c:65:import_set_state_nolock()) 00000000b5a73527 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790096663.420852:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b5a73527 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096663.420897:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9bda6b2 x1877052324056448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096663.421056:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9bda6b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324056448:0@lo:38: 00000100:00100000:3.0:1790096663.421139:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096663.421255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056448 00000100:00100000:0.0:1790096663.421265:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056448 00000100:00100000:0.0:1790096663.421313:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096663.421320:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c642ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1877052324056448:12345-0@lo:38: 00010000:00080000:0.0:1790096663.421352:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1790096663.421405:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc97d9eae5ab5682 00000004:00100000:0.0:1790096663.421460:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790096663.421613:0:5853:0:(import.c:65:import_set_state_nolock()) 00000000a9cc8936 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096663.422382:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c642ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877052324056448:12345-0@lo:38: Request processed in 1057us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096663.422393:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790096663.423342:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f9bda6b2 x1877052324056448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790096663.423368:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790096663.423380:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790096663.423386:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790096663.423389:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000b5a73527 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790096663.423397:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9bda6b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324056448:0@lo:38: 00010000:00010000:1.0:1790096664.124819:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096665.148821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096666.174254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096667.202968:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096668.220850:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096668.545373:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006581e6b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324056576:0@lo:400: 00000100:00100000:3.0:1790096668.545489:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096668.545553:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096668.545622:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a69fd23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324056704:0@lo:400: 00000100:00100000:3.0:1790096668.545796:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096668.545835:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056704 00000100:00100000:3.0:1790096668.547045:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056704 00000100:00100000:3.0:1790096668.547134:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096668.547145:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006fa8ffbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324056704:12345-0@lo:400: 00000100:00100000:3.0:1790096668.547273:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006fa8ffbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324056704:12345-0@lo:400: Request processed in 131us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096668.547281:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790096668.547344:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007a69fd23 x1877052324056704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096668.547362:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a69fd23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324056704:0@lo:400: 00000100:00100000:3.0:1790096668.547454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056576 00000100:00100000:3.0:1790096668.547459:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056576 00000100:00100000:3.0:1790096668.547493:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790096668.547499:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c58d81e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3316:x1877052324056576:12345-0@lo:400: 00000100:00100000:3.0:1790096668.547540:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c58d81e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3316:x1877052324056576:12345-0@lo:400: Request processed in 43us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096668.547547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790096668.547606:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006581e6b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324056576:0@lo:400: 00000020:00000080:3.0:1790096668.746125:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0f107de0 20000000:00000080:3.0:1790096668.746151:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaaef5c6800 uarg=0000000000000000 20000000:01000000:3.0:1790096668.746201:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790096668.746210:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790096668.746216:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790096668.746470:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790096668.746483:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790096668.756251:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790096668.757877:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790096668.758979:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790096668.759076:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790096668.759102:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790096668.759148:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.759171:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.759180:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.759230:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.759249:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 11 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096668.759265:0:6331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a69fd23 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1877052324056832:0@lo:104: 00000100:00100000:3.0:1790096668.760687:0:6331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096668.760921:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056832 00000100:00100000:1.0:1790096668.760933:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056832 00000100:00100000:1.0:1790096668.761000:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790096668.761001:0:6331:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043726176 going to sleep for 11 seconds 00000100:00100000:1.0:1790096668.761021:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000729167da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:6331:x1877052324056832:12345-0@lo:104: 00010000:00010000:1.0:1790096668.761041:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096668.761142:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790096668.761166:0:6331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a69fd23 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1877052324056832:0@lo:104: 00000100:00100000:1.0:1790096668.761168:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000729167da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:6331:x1877052324056832:12345-0@lo:104: Request processed in 159us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096668.761189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790096668.761197:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761263:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096668.761270:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761279:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002cd3bc9e already unused, calling callback (00000000a12d8bb3) 10000000:00010000:2.0:1790096668.761283:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761292:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096668.761299:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096668.761305:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790096668.761362:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761370:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790096668.761428:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1790096668.761449:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761456:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000002cd3bc9e/0xcc97d9eae5ab5643 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab564a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.761478:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096668.761480:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096668.761481:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096668.767092:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5767114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324056960:0@lo:103: 00000100:00100000:1.0:1790096668.767209:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096668.770783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324056960 00000100:00100000:2.0:1790096668.770803:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324056960 00010000:00010000:2.0:1790096668.770981:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 12 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096668.771086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096668.771096:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000314b98b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324056960:12345-0@lo:103: 00010000:00010000:2.0:1790096668.771117:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096668.771123:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 12 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771135:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 12 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771159:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b2f5622/0xcc97d9eae5ab564a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5643 expref: 12 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771182:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771191:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771214:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771222:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771229:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771259:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771266:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004b133da1 already unused, calling callback (0000000018c6a563) 00010000:00010000:2.0:1790096668.771270:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771278:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771298:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096668.771321:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096668.771435:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000314b98b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:3315:x1877052324056960:12345-0@lo:103: Request processed in 341us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096668.771443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096668.771527:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5767114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324056960:0@lo:103: 00010000:00010000:3.0:1790096668.771912:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.771924:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096668.771930:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004b133da1/0xcc97d9eae5ab5689 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096669.248259:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096670.269806:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096671.299414:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790096672.061266:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790096672.061272:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac41f3800 from 1 10000000:01000000:0.0:1790096672.061276:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790096672.061318:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000d0054d20/0xcc97d9eae5ab5690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096672.061330:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000d0054d20/0xcc97d9eae5ab5690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096672.061341:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000d0054d20/0xcc97d9eae5ab5690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096672.061365:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4b22d4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057088:0@lo:101: 00000100:00100000:0.0:1790096672.061437:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096672.061489:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e770bc1 going to sleep for 11 seconds 00000100:00100000:1.0:1790096672.062100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057088 00000100:00100000:1.0:1790096672.062110:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057088 00000100:00100000:1.0:1790096672.062168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790096672.062176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf04351c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:5849:x1877052324057088:12345-0@lo:101: 00010000:00010000:1.0:1790096672.062190:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096672.062204:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031b4e501/0xcc97d9eae5ab5697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5690 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096672.062227:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031b4e501/0xcc97d9eae5ab5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096672.062237:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031b4e501/0xcc97d9eae5ab5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096672.062256:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031b4e501, rc 0) 00000100:00100000:1.0:1790096672.062307:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf04351c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324057088:12345-0@lo:101: Request processed in 133us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096672.062314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790096672.062365:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4b22d4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057088:0@lo:101: 00010000:00010000:1.0:1790096672.062380:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000d0054d20/0xcc97d9eae5ab5690 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096672.062399:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000d0054d20/0xcc97d9eae5ab5690 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096672.062459:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011bf8679 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057216:0@lo:501: 00000100:00100000:1.0:1790096672.062487:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096672.062512:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6a3be43 going to sleep for 11 seconds 00000100:00100000:0.0:1790096672.063436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057216 00000100:00100000:0.0:1790096672.063446:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057216 00000100:00100000:0.0:1790096672.063491:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790096672.063499:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000671fe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324057216:12345-0@lo:501: 00000100:00100000:0.0:1790096672.063825:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000671fe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324057216:12345-0@lo:501: Request processed in 326us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096672.063843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790096672.064040:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011bf8679 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057216:0@lo:501: 00000100:00100000:0.0:1790096672.064083:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb8d2697 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057344:0@lo:503: 00000100:00100000:0.0:1790096672.064126:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096672.064155:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acc1d484 going to sleep for 11 seconds 00000100:00100000:0.0:1790096672.064168:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057344 00000100:00100000:0.0:1790096672.064171:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057344 00000100:00100000:0.0:1790096672.064190:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790096672.064196:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000278f886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324057344:12345-0@lo:503: 00000100:00100000:0.0:1790096672.064417:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000278f886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324057344:12345-0@lo:503: Request processed in 221us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096672.064424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790096672.064460:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb8d2697 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324057344:0@lo:503: 00000100:00100000:1.0:1790096672.069813:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ca55d51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6494:1877052324057472:0@lo:502: 00000100:00100000:1.0:1790096672.069912:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096672.069954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057472 00000100:00100000:1.0:1790096672.069962:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057472 00000100:00100000:1.0:1790096672.070014:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790096672.070023:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c222b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6494:x1877052324057472:12345-0@lo:502: 00000100:00100000:1.0:1790096672.070239:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c222b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6494:x1877052324057472:12345-0@lo:502: Request processed in 217us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096672.070261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790096672.070315:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000005beaa950 going to sleep for 11 seconds 00000100:00100000:1.0:1790096672.070339:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ca55d51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6494:1877052324057472:0@lo:502: 00000020:01000000:1.0:1790096672.070369:0:6494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096672.070378:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096672.070380:0:6494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790096672.070387:0:6494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac41f3800 00000020:00000080:1.0:1790096672.070390:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790096672.070426:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6494:1877052324057600:0@lo:502: 00000100:00100000:1.0:1790096672.070459:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096672.070478:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057600 00000100:00100000:1.0:1790096672.070481:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057600 00000100:00100000:1.0:1790096672.070509:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790096672.070515:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6494:x1877052324057600:12345-0@lo:502: 00000100:00100000:1.0:1790096672.070625:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6494:x1877052324057600:12345-0@lo:502: Request processed in 110us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096672.070662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790096672.070692:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac556c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096672.070704:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6494:1877052324057600:0@lo:502: 00000020:01000000:1.0:1790096672.070722:0:6494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096672.070727:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096672.070728:0:6494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790096672.070732:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790096672.070798:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790096672.070812:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096672.070822:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096672.070833:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096672.319600:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096673.340822:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096673.662059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096673.662084:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324057728:0@lo:400: 00000100:00100000:0.0:1790096673.662155:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096673.662213:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324057856:0@lo:400: 00000100:00100000:0.0:1790096673.662247:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096673.662283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057728 00000100:00100000:0.0:1790096673.662291:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057728 00000100:00100000:0.0:1790096673.662334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790096673.662343:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3314:x1877052324057728:12345-0@lo:400: 00000100:00100000:0.0:1790096673.662393:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3314:x1877052324057728:12345-0@lo:400: Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096673.662400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790096673.662445:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057856 00000100:00100000:0.0:1790096673.662449:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057856 00000100:00100000:0.0:1790096673.662477:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096673.662483:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324057856:12345-0@lo:400: 00000100:00100000:0.0:1790096673.662521:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324057856:12345-0@lo:400: Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096673.662527:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790096673.662567:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaafbca0700 x1877052324057856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096673.662582:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324057856:0@lo:400: 00000100:00100000:0.0:1790096673.662606:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324057728:0@lo:400: 00010000:00010000:2.0:1790096674.365333:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096675.394745:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790096675.479466:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790096675.479475:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790096675.479581:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eaac4279800 00000020:01000004:3.0:1790096675.479597:0:6692:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790096675.479608:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790096675.479622:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eaaef59cd40) 00000020:00000080:3.0:1790096675.479670:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790096675.503005:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790096675.503269:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790096675.535694:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790096675.540698:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790096675.540731:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790096675.540787:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790096675.540809:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790096675.541203:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790096675.541214:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790096675.541225:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc97d9eae5ab56a5 00000020:01000004:0.0:1790096675.541235:0:6692:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790096675.541257:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790096675.541261:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790096675.541267:0:6692:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790096675.541271:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790096675.541282:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eaac97d19c0) 00000020:00000080:0.0:1790096675.541290:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1790096675.542988:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096675.543177:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790096675.543185:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790096675.545425:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790096675.545436:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790096675.546113:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790096675.546120:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790096675.555708:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096675.556229:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790096675.556237:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790096675.557405:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790096675.557422:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790096675.592356:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096675.594077:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790096675.594086:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790096675.595782:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790096675.595793:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790096675.599735:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790096675.599752:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790096675.613338:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790096675.614266:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790096675.614274:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790096675.615301:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790096675.615310:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790096675.677256:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096675.677529:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790096675.677536:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790096675.679333:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790096675.679347:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790096675.680053:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790096675.680085:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790096675.680093:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790096675.706096:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790096675.706141:0:6692:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1790096675.706145:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790096675.706148:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790096675.706149:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096675.706151:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096675.706152:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096675.706153:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096675.706155:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096675.706156:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790096675.706157:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790096675.706158:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096675.706160:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096675.706163:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1790096675.706165:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096675.706167:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790096675.706168:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096675.706169:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096675.706170:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096675.706172:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096675.706173:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096675.706174:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790096675.706175:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790096675.706176:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096675.706177:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096675.706204:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790096675.706222:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324057984:0@lo:253: 00000100:00100000:3.0:1790096675.706295:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.706397:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae63320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.708040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324057984 00000100:00100000:0.0:1790096675.708053:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324057984 00000100:00100000:0.0:1790096675.708108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790096675.708117:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324057984:12345-0@lo:253: 20000000:01000000:0.0:1790096675.708170:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790096675.708174:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1790096675.708179:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1790096675.708182:0:5844:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1790096675.712273:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096675.712513:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790096675.712529:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790096675.712570:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1790096675.712578:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790096675.712608:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1790096675.713344:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1790096675.714627:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790096675.714757:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:0.0:1790096675.714760:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790096675.714797:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790096675.714937:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790096675.715004:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790096675.715015:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790096675.715047:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790096675.715056:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790096675.715084:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790096675.715128:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1790096675.716196:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790096675.716219:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:0.0:1790096675.716221:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790096675.716256:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1790096675.716263:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790096675.716291:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1790096675.716297:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790096675.716340:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1790096675.716349:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790096675.716395:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1790096675.716427:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1790096675.716442:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790096675.716445:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790096675.716448:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790096675.716461:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790096675.716464:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790096675.716495:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790096675.716497:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790096675.717792:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790096675.717929:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790096675.718035:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790096675.718338:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790096675.718375:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790096675.718450:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790096675.718463:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790096675.718466:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790096675.720435:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790096675.720511:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790096675.720558:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790096675.721378:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1790096675.721420:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1790096675.721453:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1790096675.721466:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790096675.721468:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790096675.722047:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1790096675.722287:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1790096675.722323:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1790096675.722383:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1790096675.722400:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1790096675.722409:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1790096675.722417:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790096675.722437:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722454:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722462:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722468:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722476:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722515:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.722529:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 12 pid: 5846 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.722543:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058112:0@lo:104: 00000100:00100000:1.0:1790096675.722603:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096675.723050:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.723060:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 12 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.723068:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058240:0@lo:104: 00000100:00100000:1.0:1790096675.723099:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096675.723253:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.723262:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.723271:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058368:0@lo:104: 00000100:00100000:1.0:1790096675.723291:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096675.723329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058112 00000100:00100000:2.0:1790096675.723337:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058112 00000100:00100000:2.0:1790096675.723370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058240 00000100:00100000:2.0:1790096675.723373:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058240 00000100:00100000:2.0:1790096675.723386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096675.723395:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:5844:x1877052324058112:12345-0@lo:104: 00010000:00010000:2.0:1790096675.723408:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723463:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790096675.723469:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:5844:x1877052324058112:12345-0@lo:104: Request processed in 75us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.723476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096675.723494:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096675.723500:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5844:x1877052324058240:12345-0@lo:104: 00010000:00010000:2.0:1790096675.723507:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723537:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790096675.723542:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5844:x1877052324058240:12345-0@lo:104: Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.723547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790096675.723566:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096675.723577:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723584:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1486400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096675.723587:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723596:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096675.723603:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096675.723609:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790096675.723659:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723665:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096675.723682:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723689:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1486400/0xcc97d9eae5ab5651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5658 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723701:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096675.723704:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723710:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096675.723713:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723729:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096675.723735:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096675.723740:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790096675.723753:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723759:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096675.723770:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723777:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1538200/0xcc97d9eae5ab55e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55e8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.723787:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096675.723788:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096675.723789:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096675.723862:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096675.723870:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096675.723883:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324058624:0@lo:103: 00000100:00100000:3.0:1790096675.723916:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096675.724129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058624 00000100:00100000:2.0:1790096675.724135:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058624 00010000:00010000:2.0:1790096675.724156:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096675.724187:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096675.724194:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3315:x1877052324058624:12345-0@lo:103: 00010000:00010000:2.0:1790096675.724204:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096675.724208:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.724223:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.724238:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096675.724265:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3315:x1877052324058624:12345-0@lo:103: Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.724271:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790096675.724344:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324058624:0@lo:103: 00000100:00100000:1.0:1790096675.724426:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108240 going to sleep for 11 seconds 00000100:00100000:1.0:1790096675.724440:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058112:0@lo:104: 00010000:00010000:1.0:1790096675.724448:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab55e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab55e1 expref: 12 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.724460:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058240:0@lo:104: 00000100:00100000:2.0:1790096675.724505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058368 00000100:00100000:2.0:1790096675.724509:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058368 00000100:00100000:2.0:1790096675.724527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096675.724533:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5844:x1877052324058368:12345-0@lo:104: 00010000:00010000:2.0:1790096675.724541:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.724591:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790096675.724596:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5844:x1877052324058368:12345-0@lo:104: Request processed in 64us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.724602:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790096675.724658:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096675.724663:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724671:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096675.724674:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724682:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096675.724689:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096675.724694:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790096675.724717:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724724:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096675.724734:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724741:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab55c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab55cc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724760:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096675.724761:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096675.724763:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096675.724772:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324058752:0@lo:103: 00000100:00100000:3.0:1790096675.724809:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.724843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058752 00000100:00100000:3.0:1790096675.724847:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058752 00010000:00010000:3.0:1790096675.724864:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.724882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790096675.724888:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324058752:12345-0@lo:103: 00010000:00010000:3.0:1790096675.724896:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096675.724899:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724907:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 12 pid: 5845 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.724916:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096675.724941:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324058752:12345-0@lo:103: Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.724947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790096675.724984:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324058752:0@lo:103: 00010000:00010000:1.0:1790096675.725214:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486000/0xcc97d9eae5ab55cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab55c5 expref: 11 pid: 5845 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.725225:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1877052324058368:0@lo:104: 00010000:00010000:1.0:1790096675.725246:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096675.725321:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324058496:0@lo:103: 00000100:00100000:0.0:1790096675.725352:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.725450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058496 00000100:00100000:3.0:1790096675.725454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058496 00010000:00010000:3.0:1790096675.725471:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 11 pid: 5846 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.725530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790096675.725537:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:3317:x1877052324058496:12345-0@lo:103: 00010000:00010000:3.0:1790096675.725546:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096675.725550:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 11 pid: 5846 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725559:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 11 pid: 5846 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725570:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539200/0xcc97d9eae5ab5658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5651 expref: 11 pid: 5846 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725583:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725591:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725605:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725612:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725619:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725624:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725667:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1487c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096675.725671:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725679:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725694:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.725702:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096675.725733:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:3317:x1877052324058496:12345-0@lo:103: Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.725739:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790096675.725790:0:5844:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.725810:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.725817:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790096675.725836:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790096675.726251:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324058496:0@lo:103: 00000100:00100000:0.0:1790096675.765925:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:6692:x1877052324057984:12345-0@lo:253: Request processed in 57801us (59621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.765939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790096675.766106:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324057984:0@lo:253: 10000000:01000000:1.0:1790096675.766123:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790096675.766127:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790096675.766128:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790096675.766129:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096675.766130:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1790096675.766132:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096675.766133:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096675.766134:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790096675.766136:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790096675.766137:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096675.766138:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790096675.766156:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eaac4279800 from lustre-OST0000 10000000:01000000:1.0:1790096675.766183:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790096675.766186:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790096675.766192:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eaac97d4d40 local copy 10000000:01000000:1.0:1790096675.766196:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790096675.766233:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.766244:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.766253:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.766270:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324058880:0@lo:101: 00000100:00100000:1.0:1790096675.766305:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.766357:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb1080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.766669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324058880 00000100:00100000:0.0:1790096675.766676:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324058880 00000100:00100000:0.0:1790096675.766716:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790096675.766724:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:6692:x1877052324058880:12345-0@lo:101: 00010000:00010000:0.0:1790096675.766738:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096675.766750:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab56c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab56ba expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.766772:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab56c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56ba expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.766783:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab56c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56ba expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.766791:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac0031c00, rc 0) 00000100:00100000:0.0:1790096675.766839:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:6692:x1877052324058880:12345-0@lo:101: Request processed in 115us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.766845:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790096675.766977:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324058880:0@lo:101: 00010000:00010000:3.0:1790096675.766990:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.766999:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.767090:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059008:0@lo:501: 00000100:00100000:3.0:1790096675.767117:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.767145:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae63320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.767200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059008 00000100:00100000:0.0:1790096675.767217:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059008 00000100:00100000:0.0:1790096675.767248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790096675.767255:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:6692:x1877052324059008:12345-0@lo:501: 00000100:00100000:0.0:1790096675.767427:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:6692:x1877052324059008:12345-0@lo:501: Request processed in 172us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096675.767435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790096675.767511:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059008:0@lo:501: 10000000:01000000:3.0:1790096675.767523:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790096675.767547:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790096675.767562:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767570:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767577:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767601:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790096675.767621:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eaac4279800 10000000:01000000:3.0:1790096675.767626:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790096675.767630:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eaac97d4d40 10000000:01000000:3.0:1790096675.767659:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790096675.767663:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9eaac97d4d40 from 1 10000000:01000000:3.0:1790096675.767665:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790096675.767682:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767689:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767696:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.767708:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059136:0@lo:101: 00000100:00100000:3.0:1790096675.767733:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.767753:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6332d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096675.767767:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059136 00000100:00100000:3.0:1790096675.767771:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059136 00000100:00100000:3.0:1790096675.767797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790096675.767810:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+10:6692:x1877052324059136:12345-0@lo:101: 00010000:00010000:3.0:1790096675.767818:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096675.767827:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab56cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab56c8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab56cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56c8 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767927:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab56cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56c8 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.767934:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ec00, rc 0) 00000100:00100000:3.0:1790096675.767973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:6692:x1877052324059136:12345-0@lo:101: Request processed in 164us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.767979:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790096675.768011:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059136:0@lo:101: 00010000:00010000:3.0:1790096675.768020:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768028:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096675.768041:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790096675.768053:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768061:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096675.768078:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790096675.768081:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790096675.768084:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790096675.768086:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790096675.768100:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768107:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768114:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.768125:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059264:0@lo:101: 00000100:00100000:3.0:1790096675.768149:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.768161:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6332d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096675.768175:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059264 00000100:00100000:3.0:1790096675.768178:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059264 00000100:00100000:3.0:1790096675.768196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790096675.768202:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:6692:x1877052324059264:12345-0@lo:101: 00010000:00010000:3.0:1790096675.768209:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096675.768216:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab56d6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768229:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768236:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768249:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ea00, rc 0) 00000100:00100000:3.0:1790096675.768278:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059264:12345-0@lo:101: Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.768284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790096675.768315:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059264:0@lo:101: 00010000:00010000:3.0:1790096675.768327:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.768335:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.768407:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059392:0@lo:501: 00000100:00100000:3.0:1790096675.768433:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.768446:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6332d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096675.768459:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059392 00000100:00100000:3.0:1790096675.768463:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059392 00000100:00100000:3.0:1790096675.768480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790096675.768486:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059392:12345-0@lo:501: 00000100:00100000:3.0:1790096675.768685:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059392:12345-0@lo:501: Request processed in 198us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.768692:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790096675.768721:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059392:0@lo:501: 00000100:00100000:3.0:1790096675.768744:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059520:0@lo:503: 00000100:00100000:3.0:1790096675.768779:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.768798:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6332d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096675.768814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059520 00000100:00100000:3.0:1790096675.768818:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059520 00000100:00100000:1.0:1790096675.768950:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790096675.768975:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059520:12345-0@lo:503: 00000100:00100000:1.0:1790096675.769119:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059520:12345-0@lo:503: Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096675.769125:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1790096675.769302:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096675.769311:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.769319:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1487c00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096675.769323:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.769332:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096675.769339:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096675.769345:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096675.769367:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.769374:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096675.769402:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.769409:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1487c00/0xcc97d9eae5ab56ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab56c1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.769434:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096675.769436:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096675.769437:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096675.769445:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096675.769457:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324059648:0@lo:103: 00000100:00100000:0.0:1790096675.769487:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096675.769880:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059520:0@lo:503: 00000040:00080000:0.0:1790096675.770153:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790096675.770211:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059776:0@lo:502: 00000100:00100000:0.0:1790096675.770249:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096675.770285:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac42d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.770304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059776 00000100:00100000:0.0:1790096675.770310:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059776 00000100:00100000:0.0:1790096675.770339:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790096675.770346:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059776:12345-0@lo:502: 00000100:00100000:0.0:1790096675.770487:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059776:12345-0@lo:502: Request processed in 140us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.770494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790096675.770534:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059776:0@lo:502: 00000040:00080000:0.0:1790096675.770789:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790096675.770832:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790096675.770865:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790096675.770912:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790096675.770947:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790096675.770993:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790096675.771016:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059904:0@lo:502: 00000100:00100000:0.0:1790096675.771057:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096675.771074:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac42d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.771091:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059904 00000100:00100000:0.0:1790096675.771096:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059904 00000100:00100000:0.0:1790096675.771115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790096675.771120:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059904:12345-0@lo:502: 00000100:00100000:0.0:1790096675.771260:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324059904:12345-0@lo:502: Request processed in 138us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.771266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790096675.771309:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324059904:0@lo:502: 00000040:00080000:0.0:1790096675.771381:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790096675.771389:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:3.0:1790096675.772415:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324059648 00000100:00100000:3.0:1790096675.772424:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324059648 00000100:00100000:3.0:1790096675.772476:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096675.772485:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3317:x1877052324059648:12345-0@lo:103: 00010000:00010000:3.0:1790096675.772497:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096675.772515:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab56c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab56ba expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.772531:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096675.772583:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:3317:x1877052324059648:12345-0@lo:103: Request processed in 100us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.772590:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096675.772719:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324059648:0@lo:103: 00000020:01000000:1.0:1790096675.772951:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790096675.772967:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790096675.772974:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096675.772976:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790096675.772982:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096675.772996:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eaad1864d40) 00000020:00000080:1.0:1790096675.773014:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790096675.773021:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790096675.773096:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaac4279800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790096675.773104:0:6711:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790096675.773111:0:6711:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc97d9eae5ab56eb 00010000:00010000:1.0:1790096675.783304:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1790096675.783627:0:6711:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1790096675.793806:0:6711:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790096675.794198:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790096675.802430:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790096675.804399:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790096675.807246:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790096675.807259:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096675.807267:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096675.807269:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790096675.807273:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096675.807278:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096675.807279:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790096675.807282:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790096675.807285:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790096675.807337:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096675.807340:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096675.807348:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790096675.807351:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790096675.807700:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1790096675.807728:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790096675.807745:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.807758:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096675.807767:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac4279800 from 1 10000000:01000000:1.0:1790096675.807769:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096675.807808:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.807815:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.807846:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.807870:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060032:0@lo:101: 00000100:00100000:1.0:1790096675.807947:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.808004:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096675.808032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060032 00000100:00100000:1.0:1790096675.808041:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060032 00000100:00100000:1.0:1790096675.808083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790096675.808092:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:6692:x1877052324060032:12345-0@lo:101: 00010000:00010000:1.0:1790096675.808107:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096675.808119:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab56f2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.808143:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.808154:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.808161:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1487c00, rc 0) 00000100:00100000:1.0:1790096675.808199:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060032:12345-0@lo:101: Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096675.808206:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790096675.808256:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060032:0@lo:101: 00010000:00010000:1.0:1790096675.808272:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.808290:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096675.808388:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060160:0@lo:501: 00000100:00100000:1.0:1790096675.808414:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.808427:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096675.808730:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060160 00000100:00100000:2.0:1790096675.808735:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060160 00000100:00100000:2.0:1790096675.808767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790096675.808774:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060160:12345-0@lo:501: 00000100:00100000:2.0:1790096675.809023:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060160:12345-0@lo:501: Request processed in 249us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.809030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790096675.809863:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060160:0@lo:501: 00000100:00100000:1.0:1790096675.809906:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060288:0@lo:503: 00000100:00100000:1.0:1790096675.810130:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.810165:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096675.810256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060288 00000100:00100000:2.0:1790096675.810262:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060288 00000100:00100000:2.0:1790096675.810307:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790096675.810315:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060288:12345-0@lo:503: 00000100:00100000:2.0:1790096675.810570:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060288:12345-0@lo:503: Request processed in 256us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.810577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790096675.810736:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060288:0@lo:503: 00000040:00080000:1.0:1790096675.811219:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790096675.811281:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060416:0@lo:502: 00000100:00100000:1.0:1790096675.811325:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.811360:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096675.811410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060416 00000100:00100000:2.0:1790096675.811415:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060416 00000100:00100000:2.0:1790096675.811490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790096675.811499:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060416:12345-0@lo:502: 00000100:00100000:2.0:1790096675.811699:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060416:12345-0@lo:502: Request processed in 201us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.811707:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790096675.811785:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060416:0@lo:502: 00000040:00080000:1.0:1790096675.812057:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790096675.812103:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790096675.812127:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060544:0@lo:502: 00000100:00100000:1.0:1790096675.812163:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.814723:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb108480 going to sleep for 11 seconds 00000100:00100000:3.0:1790096675.814971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060544 00000100:00100000:3.0:1790096675.814981:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060544 00000100:00100000:3.0:1790096675.815025:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790096675.815034:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060544:12345-0@lo:502: 00000100:00100000:3.0:1790096675.815299:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060544:12345-0@lo:502: Request processed in 265us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.815306:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790096675.818121:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060544:0@lo:502: 00000040:00080000:1.0:1790096675.818300:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790096675.818316:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790096675.822319:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096675.822330:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096675.822332:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790096675.822338:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac4279800 00000020:00000080:2.0:1790096675.822341:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790096675.822358:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096675.822371:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096675.822373:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790096675.822376:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790096675.822523:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790096675.822546:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790096675.822600:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.822612:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096675.822691:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790096675.822695:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eaac4279800 10000000:01000000:3.0:1790096675.822698:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eaac4279800 10000000:01000000:3.0:1790096675.822701:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790096675.822707:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac4279800 from 1 10000000:01000000:3.0:1790096675.822710:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790096675.822745:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.822754:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.822765:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.822789:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060672:0@lo:101: 00000100:00100000:3.0:1790096675.823073:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.823166:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14480 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.823244:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060672 00000100:00100000:0.0:1790096675.823252:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060672 00000100:00100000:0.0:1790096675.823317:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790096675.823326:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324060672:12345-0@lo:101: 00010000:00010000:0.0:1790096675.823339:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096675.823351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5700 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.823373:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.823398:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096675.823407:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac0031200, rc 0) 00000100:00100000:0.0:1790096675.823452:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324060672:12345-0@lo:101: Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.823458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790096675.823523:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060672:0@lo:101: 00010000:00010000:3.0:1790096675.823537:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.823545:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.823665:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060800:0@lo:501: 00000100:00100000:3.0:1790096675.823691:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.823859:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096675.824083:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060800 00000100:00100000:2.0:1790096675.824088:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060800 00000100:00100000:2.0:1790096675.824111:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790096675.824117:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324060800:12345-0@lo:501: 00000100:00100000:2.0:1790096675.824324:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324060800:12345-0@lo:501: Request processed in 206us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.824331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790096675.824394:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060800:0@lo:501: 00000100:00100000:3.0:1790096675.824422:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060928:0@lo:503: 00000100:00100000:3.0:1790096675.824459:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.824480:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096675.824522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324060928 00000100:00100000:2.0:1790096675.824526:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324060928 00000100:00100000:2.0:1790096675.824542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790096675.824548:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324060928:12345-0@lo:503: 00000100:00100000:2.0:1790096675.824717:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324060928:12345-0@lo:503: Request processed in 168us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096675.824724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790096675.825587:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324060928:0@lo:503: 00000040:00080000:3.0:1790096675.825908:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790096675.826007:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061056:0@lo:502: 00000100:00100000:3.0:1790096675.826056:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.826082:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14480 going to sleep for 11 seconds 00000100:00100000:0.0:1790096675.826514:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061056 00000100:00100000:0.0:1790096675.826521:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061056 00000100:00100000:0.0:1790096675.826560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096675.826568:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324061056:12345-0@lo:502: 00000100:00100000:0.0:1790096675.826770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324061056:12345-0@lo:502: Request processed in 202us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096675.826777:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790096675.827349:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061056:0@lo:502: 00000040:00080000:3.0:1790096675.827722:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790096675.827775:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790096675.827806:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790096675.828135:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790096675.828177:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790096675.828221:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790096675.828253:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790096675.828284:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790096675.828326:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790096675.828359:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790096675.828390:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790096675.828433:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790096675.829175:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790096675.829215:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790096675.829267:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790096675.829301:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790096675.829332:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790096675.829396:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790096675.829438:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790096675.830475:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790096675.830562:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790096675.830596:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790096675.830624:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790096675.830690:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790096675.830722:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790096675.830751:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790096675.830793:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790096675.830822:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1790096675.830883:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061184:0@lo:502: 00000100:00100000:3.0:1790096675.832339:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.832425:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096675.833270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061184 00000100:00100000:1.0:1790096675.833281:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061184 00000100:00100000:1.0:1790096675.833410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790096675.833421:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324061184:12345-0@lo:502: 00000100:00100000:1.0:1790096675.833706:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324061184:12345-0@lo:502: Request processed in 287us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096675.833715:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790096675.833812:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061184:0@lo:502: 00000040:00080000:3.0:1790096675.833950:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790096675.833973:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790096675.834795:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790096675.834810:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eaaef5999c0) 00000020:00000080:3.0:1790096675.834842:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1790096675.834920:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaac4279800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790096675.834924:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaac4279800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790096675.834926:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac4279800 3 00010000:00080000:3.0:1790096675.835118:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaaff5d3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790096675.842256:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1790096675.842457:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790096675.842494:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790096675.842509:0:6716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcc97d9eae5ab5715 00000100:00080000:3.0:1790096675.842520:0:6716:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790096675.842532:0:6716:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eaaff5d3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096675.842566:0:6716:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b42300 x1877052324061312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790096675.842659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324061312:0@lo:38: 00000100:00100000:2.0:1790096675.842731:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790096675.846327:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790096675.846436:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324061440:0@lo:400: 00000100:00100000:3.0:1790096675.846515:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096675.846567:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061312 00000100:00100000:3.0:1790096675.846576:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061312 00000100:00100000:3.0:1790096675.846604:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061440 00000100:00100000:3.0:1790096675.846607:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061440 00000100:00100000:3.0:1790096675.846631:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790096675.846655:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324061440:12345-0@lo:400: 00000100:00100000:3.0:1790096675.846708:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324061440:12345-0@lo:400: Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.846715:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790096675.846732:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790096675.846737:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1877052324061312:12345-0@lo:38: 00010000:00080000:3.0:1790096675.846758:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1790096675.846788:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc97d9eae5ab571c 00000004:00100000:3.0:1790096675.846801:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790096675.846844:0:5853:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790096675.847991:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877052324061312:12345-0@lo:38: Request processed in 1247us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.848001:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790096675.848057:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaf3b40700 x1877052324061440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096675.848072:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324061440:0@lo:400: 00000040:00080000:3.0:1790096675.849101:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1790096675.850722:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790096675.850759:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790096675.850784:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.850797:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790096675.850952:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790096675.850955:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790096675.850965:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096675.850967:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790096675.850968:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096675.850970:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096675.850971:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790096675.850973:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790096675.850974:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790096675.850975:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096675.850977:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790096675.850981:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790096675.850983:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790096675.850985:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790096675.850986:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790096675.850987:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790096675.850988:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790096675.850989:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790096675.850989:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790096675.850996:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790096675.850997:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790096675.850997:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790096675.850998:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790096675.851026:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790096675.851044:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061568:0@lo:253: 00000100:00100000:1.0:1790096675.851114:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096675.851159:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061568 00000100:00100000:1.0:1790096675.851167:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061568 00000100:00100000:1.0:1790096675.851217:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790096675.851226:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6692:x1877052324061568:12345-0@lo:253: 20000000:01000000:1.0:1790096675.851266:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790096675.851280:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1790096675.852249:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaf3b42300 x1877052324061312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096675.852264:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790096675.852273:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1790096675.852281:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790096675.852287:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790096675.852291:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790096675.852298:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324061312:0@lo:38: 00000100:00100000:1.0:1790096675.853308:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707540 going to sleep for 11 seconds 20000000:01000000:1.0:1790096675.881139:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790096675.881158:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790096675.881216:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790096675.881221:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790096675.881244:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.881263:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.881270:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.881311:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.881327:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096675.881355:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324061696:0@lo:104: 00000100:00100000:2.0:1790096675.881418:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096675.881477:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac59046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096675.881991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061696 00000100:00100000:1.0:1790096675.882001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061696 00000100:00100000:1.0:1790096675.882046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790096675.882055:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324061696:12345-0@lo:104: 00010000:00010000:1.0:1790096675.882069:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096675.882130:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790096675.882136:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324061696:12345-0@lo:104: Request processed in 83us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096675.882143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096675.882255:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324061696:0@lo:104: 00010000:00010000:2.0:1790096675.882280:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883626:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096675.883651:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883662:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0031800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096675.883667:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883676:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096675.883683:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096675.883690:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790096675.883727:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883734:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790096675.883793:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324061824:0@lo:103: 00000100:00100000:1.0:1790096675.883855:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790096675.883910:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883919:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab5674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab567b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.883936:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096675.883938:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096675.883940:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096675.883953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061824 00000100:00100000:3.0:1790096675.883969:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061824 00010000:00010000:3.0:1790096675.883996:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 14 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.884034:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790096675.884042:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3314:x1877052324061824:12345-0@lo:103: 00010000:00010000:3.0:1790096675.884054:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096675.884059:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 14 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884071:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 14 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884085:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab567b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5674 expref: 14 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884099:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884106:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790096675.884122:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008038926s 00010000:00010000:3.0:1790096675.884127:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884134:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884140:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884146:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884158:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096675.884162:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884169:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884188:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096675.884199:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096675.884474:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.884483:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096675.884489:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab5723 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096675.887270:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3314:x1877052324061824:12345-0@lo:103: Request processed in 3219us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096675.887283:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790096675.887479:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324061824:0@lo:103: 00000100:00100000:1.0:1790096675.888790:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:6692:x1877052324061568:12345-0@lo:253: Request processed in 37560us (37673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096675.888801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790096675.888931:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6692:1877052324061568:0@lo:253: 10000000:01000000:0.0:1790096675.888946:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790096675.888950:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096675.888952:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790096675.888953:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096675.888954:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096675.888955:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096675.888972:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096675.888974:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096675.888976:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096675.888977:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096675.888978:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096675.888979:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790096675.888994:0:6692:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790096675.895545:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790096675.895914:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790096675.896150:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790096675.896337:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790096675.896530:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790096675.897178:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790096675.901718:0:6692:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790096676.117981:0:6692:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790096676.117991:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790096676.118031:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790096676.118096:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790096676.118110:0:6692:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790096676.118129:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790096676.412929:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096677.443201:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096678.460827:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096679.486683:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096680.509786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096681.342874:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324062080:0@lo:400: 00000100:00100000:2.0:1790096681.343001:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.343076:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096681.343082:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324062208:0@lo:400: 00000100:00100000:2.0:1790096681.343107:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.343160:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062080 00000100:00100000:2.0:1790096681.343170:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062080 00000100:00100000:2.0:1790096681.343226:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062208 00000100:00100000:2.0:1790096681.343229:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062208 00000100:00100000:2.0:1790096681.343259:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096681.343269:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324062080:12345-0@lo:400: 00000100:00100000:2.0:1790096681.343341:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324062080:12345-0@lo:400: Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096681.343349:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096681.343366:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096681.343372:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324062208:12345-0@lo:400: 00000100:00100000:2.0:1790096681.343397:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324062208:12345-0@lo:400: Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096681.343403:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790096681.343449:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79500 x1877052324062208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096681.343969:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324061952:0@lo:400: 00000100:00100000:1.0:1790096681.344018:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790096681.344071:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096681.344087:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324061952 00000100:00100000:1.0:1790096681.344091:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324061952 00000100:00100000:1.0:1790096681.344128:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096681.344135:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324061952:12345-0@lo:400: 00000100:00100000:1.0:1790096681.344172:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324061952:12345-0@lo:400: Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096681.344179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096681.344222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324061952:0@lo:400: 00000100:00100000:2.0:1790096681.344438:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324062208:0@lo:400: 00010000:00080000:2.0:1790096681.344455:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b7ad80 x1877052324062080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096681.344476:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324062080:0@lo:400: 10000000:01000000:2.0:1790096681.347795:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790096681.347806:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac41f3800 from 21 10000000:01000000:2.0:1790096681.347815:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790096681.347868:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096681.347881:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096681.347903:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096681.347945:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062336:0@lo:101: 00000100:00100000:2.0:1790096681.348034:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.348084:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5662480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.348254:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062336 00000100:00100000:1.0:1790096681.348265:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062336 00000100:00100000:1.0:1790096681.348336:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790096681.348346:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324062336:12345-0@lo:101: 00010000:00010000:1.0:1790096681.348363:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096681.348379:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab572a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096681.348408:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096681.348444:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096681.348454:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1486200, rc 0) 00000100:00100000:1.0:1790096681.348729:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062336:12345-0@lo:101: Request processed in 383us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096681.348736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790096681.348804:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062336:0@lo:101: 00010000:00010000:1.0:1790096681.348823:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096681.348834:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096681.348912:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062464:0@lo:501: 00000100:00100000:1.0:1790096681.348951:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096681.348970:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.348987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062464 00000100:00100000:1.0:1790096681.348991:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062464 00000100:00100000:1.0:1790096681.349017:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096681.349024:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062464:12345-0@lo:501: 00000100:00100000:1.0:1790096681.349738:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062464:12345-0@lo:501: Request processed in 712us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096681.349748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096681.349792:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062464:0@lo:501: 00000100:00100000:1.0:1790096681.349827:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062592:0@lo:503: 00000100:00100000:1.0:1790096681.349874:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096681.350065:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.350084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062592 00000100:00100000:1.0:1790096681.350089:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062592 00000100:00100000:1.0:1790096681.350176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790096681.350184:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062592:12345-0@lo:503: 00000100:00100000:1.0:1790096681.350756:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062592:12345-0@lo:503: Request processed in 570us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096681.350765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790096681.355785:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062592:0@lo:503: 00000100:00100000:3.0:1790096681.356222:0:6993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6993:1877052324062720:0@lo:502: 00000100:00100000:3.0:1790096681.356332:0:6993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.356384:0:6993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5708a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.359670:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062720 00000100:00100000:1.0:1790096681.359696:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062720 00000100:00100000:1.0:1790096681.359775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790096681.359788:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6993:x1877052324062720:12345-0@lo:502: 00000100:00100000:1.0:1790096681.360884:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6993:x1877052324062720:12345-0@lo:502: Request processed in 1091us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.361053:0:6993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6993:1877052324062720:0@lo:502: 00000100:00100000:3.0:1790096681.361153:0:6993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6993:1877052324062848:0@lo:502: 00000100:00100000:3.0:1790096681.361209:0:6993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.361255:0:6993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c19356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.362651:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790096681.362724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062848 00000100:00100000:1.0:1790096681.362735:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062848 00000100:00100000:1.0:1790096681.362802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790096681.362812:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6993:x1877052324062848:12345-0@lo:502: 00000100:00100000:0.0:1790096681.366242:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:6993:x1877052324062848:12345-0@lo:502: Request processed in 3416us (5017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.366261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790096681.367041:0:6993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6993:1877052324062848:0@lo:502: 00000040:00080000:3.0:1790096681.367098:0:6993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790096681.367286:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790096681.367591:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790096681.367605:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.367617:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096681.367628:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790096681.367631:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eaac41f3800 from 4 10000000:01000000:3.0:1790096681.367678:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790096681.367730:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.367739:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.367750:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096681.367774:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062976:0@lo:101: 00000100:00100000:3.0:1790096681.368436:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.369693:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c19356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096681.369731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324062976 00000100:00100000:3.0:1790096681.369743:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324062976 00000100:00100000:3.0:1790096681.369818:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790096681.369828:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324062976:12345-0@lo:101: 00010000:00010000:3.0:1790096681.369847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096681.369873:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5738 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.369931:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.369945:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.369956:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f000, rc 0) 00000100:00100000:3.0:1790096681.370028:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324062976:12345-0@lo:101: Request processed in 201us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.370036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790096681.370096:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324062976:0@lo:101: 00010000:00010000:3.0:1790096681.370116:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.370126:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096681.370198:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063104:0@lo:256: 00000100:00100000:3.0:1790096681.370257:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.370273:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c19356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096681.370285:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063104 00000100:00100000:3.0:1790096681.370289:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063104 00000100:00100000:3.0:1790096681.370309:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790096681.370315:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324063104:12345-0@lo:256: 20000000:01000000:3.0:1790096681.370331:0:5846:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790096681.370352:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790096681.370356:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790096681.370443:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324063104:12345-0@lo:256: Request processed in 127us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.370449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790096681.371694:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063104:0@lo:256: 10000000:01000000:3.0:1790096681.371763:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790096681.371774:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.371785:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096681.371806:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790096681.371809:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790096681.371812:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790096681.371846:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.371855:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.371866:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096681.371885:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063232:0@lo:101: 00000100:00100000:3.0:1790096681.372251:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.372314:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c19356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096681.372338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063232 00000100:00100000:3.0:1790096681.372345:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063232 00000100:00100000:3.0:1790096681.372395:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790096681.372404:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324063232:12345-0@lo:101: 00010000:00010000:3.0:1790096681.372428:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096681.372443:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5746 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.373424:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.373445:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.373456:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ee00, rc 0) 00000100:00100000:3.0:1790096681.373774:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324063232:12345-0@lo:101: Request processed in 1367us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.373785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790096681.380887:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063232:0@lo:101: 00010000:00010000:2.0:1790096681.380950:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096681.380965:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096681.381082:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063360:0@lo:501: 00000100:00100000:2.0:1790096681.381174:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.385220:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5662a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.386063:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063360 00000100:00100000:0.0:1790096681.386078:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063360 00000100:00100000:0.0:1790096681.386721:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790096681.386736:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324063360:12345-0@lo:501: 00000100:00100000:0.0:1790096681.387233:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324063360:12345-0@lo:501: Request processed in 499us (6057us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.387243:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790096681.388995:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063360:0@lo:501: 00000100:00100000:1.0:1790096681.389086:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063488:0@lo:503: 00000100:00100000:1.0:1790096681.389167:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.401473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063488 00000100:00100000:3.0:1790096681.401495:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063488 00000100:00100000:3.0:1790096681.401578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790096681.401593:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324063488:12345-0@lo:503: 00000100:00100000:3.0:1790096681.402197:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324063488:12345-0@lo:503: Request processed in 606us (13027us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.402209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790096681.406145:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096681.406193:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324063488:0@lo:503: 00000100:00100000:1.0:1790096681.407073:0:6994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6994:1877052324063616:0@lo:502: 00000100:00100000:1.0:1790096681.407171:0:6994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096681.407210:0:6994:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096681.408332:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063616 00000100:00100000:2.0:1790096681.408346:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063616 00000100:00100000:2.0:1790096681.408428:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790096681.408441:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:6994:x1877052324063616:12345-0@lo:502: 00000100:00100000:2.0:1790096681.409024:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:6994:x1877052324063616:12345-0@lo:502: Request processed in 584us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096681.409034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790096681.409110:0:6994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6994:1877052324063616:0@lo:502: 00000020:01000000:1.0:1790096681.409156:0:6994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790096681.409166:0:6994:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790096681.409174:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096681.409178:0:6994:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790096681.409183:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790096681.409188:0:6994:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1790096681.409216:0:6994:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790096681.409219:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096681.409241:0:6994:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eaad18619c0) 00000020:00000080:1.0:1790096681.409269:0:6994:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790096681.409274:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790096681.409532:0:6994:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790096681.410097:0:6994:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790096681.410113:0:6994:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab575b 00010000:00080000:1.0:1790096681.410160:0:6994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaad0ebb000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790096681.410721:0:6994:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790096681.473630:0:6994:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790096681.473747:0:6994:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790096681.474602:0:6994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096681.475098:0:6994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096681.475163:0:6994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790096681.475233:0:6994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1790096681.485668:0:6999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790096681.485678:0:6999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790096681.490039:0:6994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790096681.490064:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790096681.490257:0:6994:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790096681.490289:0:6994:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab5762 00000100:00080000:0.0:1790096681.490315:0:6994:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790096681.490331:0:6994:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eaad0ebb000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790096681.490388:0:6994:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaafbca0700 x1877052324063744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790096681.490413:0:6994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790096681.490509:0:6994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096681.490514:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096681.490516:0:6994:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790096681.490519:0:6994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096681.490531:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096681.490532:0:6994:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790096681.490536:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790096681.490538:0:6994:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790096681.490572:0:6994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6994:1877052324063872:0@lo:502: 00000100:00100000:0.0:1790096681.490718:0:6994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.490787:0:6994:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.490825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063872 00000100:00100000:0.0:1790096681.490833:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063872 00000100:00100000:0.0:1790096681.490881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096681.490904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:6994:x1877052324063872:12345-0@lo:502: 00000100:00100000:2.0:1790096681.490991:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324063744:0@lo:8: 00000100:00100000:2.0:1790096681.491035:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.491076:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324063744 00000100:00100000:2.0:1790096681.491080:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324063744 00000100:00100000:2.0:1790096681.491102:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096681.491107:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324063744:12345-0@lo:8: 00010000:00080000:2.0:1790096681.491131:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1790096681.491163:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab5769 00002000:00100000:2.0:1790096681.491205:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eaaff2ce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790096681.491210:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:0.0:1790096681.491234:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:6994:x1877052324063872:12345-0@lo:502: Request processed in 343us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.491242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096681.491313:0:6994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:6994:1877052324063872:0@lo:502: 00000001:00000004:2.0:1790096681.491334:0:6694:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1790096681.491342:0:6994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096681.491346:0:6994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096681.491347:0:6994:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790096681.491352:0:6994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00100000:2.0:1790096681.491476:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1790096681.491501:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790096681.491524:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790096681.491538:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096681.491551:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096681.491564:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790096681.491569:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eaac97d4d40 from 1 10000000:01000000:0.0:1790096681.491579:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790096681.491612:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096681.491621:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096681.491632:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096681.491666:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324064128:0@lo:101: 00002000:00080000:2.0:1790096681.491689:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1790096681.491696:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790096681.491717:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9eaaff2cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096681.491727:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae2240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096681.491768:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064128 00000100:00100000:2.0:1790096681.491768:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1877052324063744:12345-0@lo:8: Request processed in 658us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.491776:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064128 00000100:00100000:2.0:1790096681.491780:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790096681.491786:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafbca0700 x1877052324063744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790096691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096681.491796:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790096681.491803:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790096681.491813:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1790096681.491816:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1790096681.491821:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790096681.491825:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaad0ebb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790096681.491827:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324064128:12345-0@lo:101: 00010000:00010000:3.0:1790096681.491839:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1790096681.491851:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790096681.491859:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324063744:0@lo:8: 00010000:00010000:3.0:1790096681.491861:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5770 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790096681.491886:0:6999:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1790096681.491891:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.491905:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096681.491915:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fe00, rc 0) 00000100:00100000:3.0:1790096681.491975:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324064128:12345-0@lo:101: Request processed in 150us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.491980:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324064128:0@lo:101: 00000100:00100000:3.0:1790096681.491986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1790096681.491997:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096681.492009:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096681.492032:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324064000:0@lo:400: 00000100:00100000:0.0:1790096681.492061:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324064384:0@lo:501: 00000100:00100000:1.0:1790096681.492075:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.492083:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.492114:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae2240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096681.492143:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064384 00000100:00100000:1.0:1790096681.492145:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096681.492148:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064384 00000100:00100000:1.0:1790096681.492154:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324064256:0@lo:400: 00000100:00100000:3.0:1790096681.492188:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790096681.492198:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324064384:12345-0@lo:501: 00000100:00100000:1.0:1790096681.492210:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096681.492730:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324064384:12345-0@lo:501: Request processed in 532us (643us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790096681.492739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790096681.492882:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324064384:0@lo:501: 10000000:01000000:0.0:1790096681.493446:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790096681.493458:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096681.493526:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790096681.493812:0:6999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211064175316ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790096681.494002:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064000 00000100:00100000:2.0:1790096681.494014:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064000 00000100:00100000:2.0:1790096681.494250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064256 00000100:00100000:2.0:1790096681.494256:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064256 00000100:00100000:2.0:1790096681.494316:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096681.494326:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324064256:12345-0@lo:400: 00000100:00100000:2.0:1790096681.494431:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324064256:12345-0@lo:400: Request processed in 107us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096681.494439:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790096681.495208:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b41880 x1877052324064256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096681.495226:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324064256:0@lo:400: 00000100:00100000:2.0:1790096681.495450:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096681.495458:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324064000:12345-0@lo:400: 00000100:00100000:2.0:1790096681.495598:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324064000:12345-0@lo:400: Request processed in 140us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096681.495606:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790096681.495733:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b41500 x1877052324064000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096681.495744:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324064000:0@lo:400: 00010000:00010000:3.0:1790096681.538550:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790096681.550014:0:7000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790096681.550060:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064640:0@lo:7: 00000100:00100000:0.0:1790096681.550154:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.550215:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.550276:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324064512:0@lo:13: 00000100:00100000:0.0:1790096681.550306:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.550358:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064640 00000100:00100000:0.0:1790096681.550367:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064640 00000100:00100000:0.0:1790096681.550433:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096681.550445:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7000:x1877052324064640:12345-0@lo:7: 00000100:00080000:1.0:1790096681.553725:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096681.553766:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064512 00000100:00100000:1.0:1790096681.553779:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064512 00000100:00100000:1.0:1790096681.553859:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096681.553871:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877052324064512:12345-0@lo:13: 00002000:00000024:1.0:1790096681.553925:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790096681.554041:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877052324064512:12345-0@lo:13: Request processed in 172us (3733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096681.554048:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790096681.557951:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafbca1180 x1877052324064512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096681.557989:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324064512:0@lo:13: 00002000:00080000:0.0:1790096681.565045:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1790096681.565057:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790096681.565193:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7000:x1877052324064640:12345-0@lo:7: Request processed in 14744us (15033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.565207:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790096681.565280:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafbca0700 x1877052324064640/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790096697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096681.565300:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064640:0@lo:7: 00000004:00080000:0.0:1790096681.565317:0:7000:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790096681.565368:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064768:0@lo:5: 00000100:00100000:0.0:1790096681.565406:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.565463:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.565491:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064768 00000100:00100000:0.0:1790096681.565498:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064768 00000100:00100000:0.0:1790096681.565543:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790096681.565553:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7000:x1877052324064768:12345-0@lo:5: 00002000:00080000:0.0:1790096681.565584:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790096681.565589:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790096681.567116:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7000:x1877052324064768:12345-0@lo:5: Request processed in 1556us (1700us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790096681.567129:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790096681.567320:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafbca0700 x1877052324064768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790096697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096681.567340:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064768:0@lo:5: 00000004:00080000:2.0:1790096681.567358:0:7000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790096681.567407:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064896:0@lo:700: 00000100:00100000:2.0:1790096681.567462:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096681.567496:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5662a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.570000:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324064896 00000100:00100000:0.0:1790096681.570023:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324064896 00000100:00100000:0.0:1790096681.570094:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096681.570104:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7000:x1877052324064896:12345-0@lo:700: 00000100:00100000:0.0:1790096681.570184:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1877052324065024:0@lo:700: 00000100:00100000:0.0:1790096681.570269:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.570319:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaae26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096681.570354:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065024 00000100:00100000:0.0:1790096681.570359:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065024 00000100:00100000:0.0:1790096681.570389:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096681.570396:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1877052324065024:12345-0@lo:700: 00000004:00080000:2.0:1790096681.641873:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1790096681.724746:0:5858:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790096681.738854:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1877052324065024:12345-0@lo:700: Request processed in 168448us (168574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096681.738878:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790096681.740711:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafbca3b80 x1877052324065024/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790096697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096681.740732:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1877052324065024:0@lo:700: 40000000:02000000:0.0:1790096681.740750:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1790096681.904686:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790096681.904712:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790096681.905041:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7000:x1877052324064896:12345-0@lo:700: Request processed in 334932us (337571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096681.905059:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790096681.905157:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79880 x1877052324064896/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790096697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096681.905171:0:7000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790096681.905204:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324064896:0@lo:700: 00000004:02000040:2.0:1790096681.961128:0:7000:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1790096681.969364:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324065152:0@lo:5: 00000100:00100000:2.0:1790096681.969578:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096681.969910:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065152 00000100:00100000:0.0:1790096681.969934:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065152 00000100:00100000:0.0:1790096681.969993:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790096681.970000:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790096681.970004:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7000:x1877052324065152:12345-0@lo:5: 00000100:00100000:1.0:1790096681.970010:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790096681.970265:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00002000:00080000:1.0:1790096681.977560:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790096681.977593:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1790096681.993556:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7000:x1877052324065152:12345-0@lo:5: Request processed in 23537us (23962us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790096681.993576:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790096681.994667:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b7b480 x1877052324065152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790096697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096681.994692:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1877052324065152:0@lo:5: 00000004:00080000:2.0:1790096681.994712:0:7000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1790096682.557689:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790096682.749143:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790096683.589899:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096684.606923:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096685.629402:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096686.659058:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096686.973621:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324065408:0@lo:400: 00000100:00100000:3.0:1790096686.973745:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096686.973821:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096686.973827:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324065536:0@lo:400: 00000100:00100000:3.0:1790096686.973857:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096686.973913:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065408 00000100:00100000:3.0:1790096686.973921:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065408 00000100:00100000:3.0:1790096686.973970:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065536 00000100:00100000:3.0:1790096686.973973:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065536 00000100:00100000:3.0:1790096686.974001:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096686.974011:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324065408:12345-0@lo:400: 00000100:00100000:3.0:1790096686.974070:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324065408:12345-0@lo:400: Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096686.974077:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096686.974095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790096686.974101:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324065536:12345-0@lo:400: 00000100:00100000:3.0:1790096686.974129:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324065536:12345-0@lo:400: Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096686.974135:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790096686.974179:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b41880 x1877052324065536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096686.974195:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324065536:0@lo:400: 00010000:00080000:3.0:1790096686.974221:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b41500 x1877052324065408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096686.974229:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324065408:0@lo:400: 00000100:00100000:0.0:1790096686.974979:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324065280:0@lo:400: 00000100:00100000:0.0:1790096686.975034:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096686.975074:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096686.975092:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324065664:0@lo:400: 00000100:00100000:0.0:1790096686.975123:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096686.975227:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065280 00000100:00100000:0.0:1790096686.975234:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065280 00000100:00100000:0.0:1790096686.975275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790096686.975284:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3317:x1877052324065280:12345-0@lo:400: 00000100:00080000:1.0:1790096686.975292:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096686.975577:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3317:x1877052324065280:12345-0@lo:400: Request processed in 293us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096686.975585:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790096686.975621:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065664 00000100:00100000:0.0:1790096686.975625:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065664 00000100:00100000:0.0:1790096686.975693:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096686.975699:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324065664:12345-0@lo:400: 00000100:00100000:0.0:1790096686.975732:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324065664:12345-0@lo:400: Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096686.975737:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790096686.975772:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b40a80 x1877052324065664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096686.975786:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324065664:0@lo:400: 00000100:00100000:0.0:1790096686.975796:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324065280:0@lo:400: 00000100:00080000:1.0:1790096686.976856:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096686.976999:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324065792:0@lo:13: 00000100:00100000:2.0:1790096686.977061:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096686.977288:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065792 00000100:00100000:1.0:1790096686.977297:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065792 00000100:00100000:1.0:1790096686.977361:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096686.977372:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324065792:12345-0@lo:13: 00002000:00000024:1.0:1790096686.977413:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096686.977470:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324065792:12345-0@lo:13: Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096686.977478:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790096686.981047:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79500 x1877052324065792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096686.981095:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324065792:0@lo:13: 00000001:00080000:2.0:1790096687.136930:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1790096687.677454:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096688.705842:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096689.726935:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096690.749132:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096691.773952:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096692.093196:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324066048:0@lo:400: 00000100:00100000:1.0:1790096692.093324:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096692.093407:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096692.093414:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324065920:0@lo:400: 00000100:00100000:1.0:1790096692.093449:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096692.093484:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324066176:0@lo:400: 00000100:00100000:1.0:1790096692.093513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096692.093533:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096692.093537:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324066304:0@lo:400: 00000100:00100000:1.0:1790096692.093570:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096692.093609:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066048 00000100:00100000:1.0:1790096692.093619:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066048 00000100:00100000:1.0:1790096692.093708:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066176 00000100:00100000:1.0:1790096692.093717:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066176 00000100:00100000:0.0:1790096692.093722:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790096692.093733:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324066048:12345-0@lo:400: 00000100:00100000:1.0:1790096692.093748:0:5852:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790096692.093806:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324066048:12345-0@lo:400: Request processed in 74us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096692.093814:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790096692.093836:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790096692.093851:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324066176:12345-0@lo:400: 00000100:00100000:0.0:1790096692.093886:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324066176:12345-0@lo:400: Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096692.093905:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790096692.093909:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066304 00000100:00100000:2.0:1790096692.093913:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066304 00010000:00080000:0.0:1790096692.093943:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad185ad80 x1877052324066176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096692.093945:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096692.093952:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324066304:12345-0@lo:400: 00000100:00100000:0.0:1790096692.093958:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324066176:0@lo:400: 00010000:00080000:0.0:1790096692.093987:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad1858a80 x1877052324066048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096692.093990:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324066304:12345-0@lo:400: Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096692.093996:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096692.093997:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324066048:0@lo:400: 00000100:00100000:0.0:1790096692.094004:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096692.094011:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324066432:0@lo:13: 00000100:00100000:0.0:1790096692.094038:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790096692.094445:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad1859500 x1877052324066304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096692.094455:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790096692.094468:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324066304:0@lo:400: 00000100:00100000:2.0:1790096692.095002:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066432 00000100:00100000:2.0:1790096692.095011:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066432 00000100:00100000:2.0:1790096692.095049:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096692.095057:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324066432:12345-0@lo:13: 00002000:00000024:2.0:1790096692.095109:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096692.095179:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324066432:12345-0@lo:13: Request processed in 122us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096692.095187:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790096692.095257:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b78000 x1877052324066432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096692.095277:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324066432:0@lo:13: 00000100:00100000:1.0:1790096692.095544:0:5852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790096692.095571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324065920 00000100:00100000:1.0:1790096692.095577:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324065920 00000100:00100000:1.0:1790096692.095608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790096692.095615:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3315:x1877052324065920:12345-0@lo:400: 00000100:00080000:3.0:1790096692.095996:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096692.096004:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096692.096428:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3315:x1877052324065920:12345-0@lo:400: Request processed in 810us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096692.097878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790096692.098273:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324065920:0@lo:400: 00010000:00010000:2.0:1790096692.803175:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096693.824473:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096694.849800:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790096695.465573:0:7643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790096695.465578:0:7643:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790096695.465765:0:7643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eaaff322800 00000020:01000004:0.0:1790096695.465787:0:7643:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790096695.465803:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790096695.467972:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eaac97d3380) 00000020:00000080:0.0:1790096695.468021:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790096695.518482:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790096695.520010:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790096695.578991:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790096695.595525:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790096695.595584:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790096695.600375:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790096695.601488:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790096695.602283:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790096695.602302:0:7643:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790096695.602319:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc97d9eae5ab5785 00000020:01000004:2.0:1790096695.602331:0:7643:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790096695.602359:0:7643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790096695.602364:0:7643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790096695.602370:0:7643:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790096695.604074:0:7643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790096695.604087:0:7643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790096695.669539:0:7643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790096695.669609:0:7643:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790096695.669615:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790096695.669617:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790096695.669619:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096695.669620:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096695.669621:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096695.669622:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096695.669624:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096695.669626:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096695.669628:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096695.669629:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096695.669631:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790096695.669665:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790096695.669669:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790096695.669671:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790096695.669672:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096695.669673:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096695.669674:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096695.669675:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096695.669676:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096695.669677:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096695.669678:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096695.669679:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096695.669680:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790096695.669854:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790096695.669891:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324066560:0@lo:253: 00000100:00100000:0.0:1790096695.670021:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.670096:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096695.670287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066560 00000100:00100000:2.0:1790096695.670297:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066560 00000100:00100000:2.0:1790096695.670353:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790096695.670364:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:7643:x1877052324066560:12345-0@lo:253: 20000000:01000000:2.0:1790096695.670405:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790096695.670410:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1790096695.670416:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1790096695.670420:0:5846:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1790096695.672249:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790096695.672518:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790096695.672537:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1790096695.672579:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790096695.672586:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1790096695.672632:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790096695.675121:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790096695.678533:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790096695.678577:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:3.0:1790096695.678580:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:3.0:1790096695.678687:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790096695.678701:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790096695.678795:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790096695.678804:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790096695.679247:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1790096695.679280:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790096695.679382:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1790096695.679482:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790096695.682314:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790096695.682406:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1790096695.682410:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1790096695.682478:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790096695.682495:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790096695.682530:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790096695.682553:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1790096695.682588:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790096695.682599:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790096695.682803:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790096695.682863:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790096695.682960:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790096695.682965:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790096695.682970:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790096695.682989:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790096695.682992:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790096695.683043:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790096695.683047:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790096695.692563:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1790096695.694850:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1790096695.694916:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1790096695.694998:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1790096695.695016:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790096695.695019:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790096695.696133:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790096695.696237:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790096695.696293:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790096695.696783:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790096695.696842:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790096695.696930:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790096695.696949:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790096695.696952:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790096695.702939:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1790096695.703037:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1790096695.703099:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790096695.705379:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1790096695.705445:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1790096695.705483:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1790096695.705502:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790096695.705504:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790096695.711166:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1790096695.711312:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1790096695.711350:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790096695.713690:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790096695.713747:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790096695.713830:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790096695.713855:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790096695.713858:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790096695.713867:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790096695.713889:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713906:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713915:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713922:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713928:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713935:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713941:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713983:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.713998:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.714012:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066688:0@lo:104: 00000100:00100000:3.0:1790096695.714086:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790096695.714154:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.714163:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.714174:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066816:0@lo:104: 00010000:00010000:3.0:1790096695.714196:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.714205:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 16 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.714214:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066944:0@lo:104: 00010000:00010000:3.0:1790096695.714234:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.714242:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.714250:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324067072:0@lo:104: 00010000:00010000:3.0:1790096695.714269:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.714277:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 16 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.714285:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324067200:0@lo:104: 00000100:00100000:3.0:1790096695.714311:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096695.714475:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790096695.714497:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.714525:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.714543:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.714550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066688 00000100:00100000:0.0:1790096695.714562:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.714568:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066688 00000100:00100000:0.0:1790096695.714731:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066816 00000100:00100000:1.0:1790096695.714737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324066944 00000100:00100000:0.0:1790096695.714741:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066816 00000100:00100000:1.0:1790096695.714745:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324066944 00000100:00100000:0.0:1790096695.714784:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067072 00000100:00100000:0.0:1790096695.714789:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067072 00000100:00100000:0.0:1790096695.714802:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067200 00000100:00100000:0.0:1790096695.714804:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067200 00000100:00100000:0.0:1790096695.714826:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096695.714836:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:5846:x1877052324066688:12345-0@lo:104: 00010000:00010000:0.0:1790096695.714849:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.714916:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096695.714922:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:5846:x1877052324066688:12345-0@lo:104: Request processed in 89us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.714929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096695.714967:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096695.714974:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5846:x1877052324066816:12345-0@lo:104: 00010000:00010000:0.0:1790096695.714982:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715027:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790096695.715033:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:5846:x1877052324066816:12345-0@lo:104: Request processed in 60us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.715040:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096695.715059:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790096695.715074:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:5846:x1877052324067072:12345-0@lo:104: 00010000:00010000:0.0:1790096695.715085:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.715086:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096695.715103:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.715117:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0030000 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096695.715122:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.715135:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715135:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790096695.715149:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:5846:x1877052324067072:12345-0@lo:104: Request processed in 74us (602us total) trans 0 rc 0/0 10000000:00010000:2.0:1790096695.715164:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096695.715165:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:01000000:2.0:1790096695.715177:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790096695.715184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790096695.715193:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:5846:x1877052324067200:12345-0@lo:104: 00010000:00010000:0.0:1790096695.715202:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715235:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1790096695.715242:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096695.715243:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:5846:x1877052324067200:12345-0@lo:104: Request processed in 52us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.715278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1790096695.715284:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790096695.715301:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790096695.715310:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5846:x1877052324066944:12345-0@lo:104: 00010000:00010000:2.0:1790096695.715319:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715321:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.715349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab5770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5777 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715354:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790096695.715363:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5846:x1877052324066944:12345-0@lo:104: Request processed in 54us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.715370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790096695.715373:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790096695.715380:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.715395:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1790096695.715593:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066688:0@lo:104: 00000100:00100000:3.0:1790096695.715614:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066816:0@lo:104: 00000100:00100000:3.0:1790096695.715622:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324066944:0@lo:104: 00000100:00100000:3.0:1790096695.715629:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324067072:0@lo:104: 00000100:00100000:3.0:1790096695.715661:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1877052324067200:0@lo:104: 00010000:00010000:3.0:1790096695.715688:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.715727:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096695.715742:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324067328:0@lo:103: 00000100:00100000:3.0:1790096695.715775:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.716059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067328 00000100:00100000:0.0:1790096695.716072:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067328 00010000:00010000:0.0:1790096695.716097:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 17 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.716195:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096695.716201:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.716213:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096695.716221:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096695.716228:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1790096695.716264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790096695.716269:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.716283:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:3314:x1877052324067328:12345-0@lo:103: 00010000:00010000:2.0:1790096695.716284:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096695.716302:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096695.716310:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 17 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.716311:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.716358:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148e800/0xcc97d9eae5ab5746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab574d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716366:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 17 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716396:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab5777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5770 expref: 17 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716424:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096695.716466:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3314:x1877052324067328:12345-0@lo:103: Request processed in 192us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.716484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790096695.716531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324067328:0@lo:103: 00000100:00100000:3.0:1790096695.716566:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324067456:0@lo:103: 00000100:00100000:3.0:1790096695.716594:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.716629:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067456 00000100:00100000:3.0:1790096695.716651:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067456 00010000:00010000:3.0:1790096695.716668:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.716687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096695.716693:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3316:x1877052324067456:12345-0@lo:103: 00010000:00010000:3.0:1790096695.716701:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096695.716705:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716714:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716725:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab574d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5746 expref: 16 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.716735:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096695.716759:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3316:x1877052324067456:12345-0@lo:103: Request processed in 66us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.716765:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096695.716786:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324067456:0@lo:103: 00010000:00010000:1.0:1790096695.717073:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096695.717478:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096695.717501:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.717511:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096695.717516:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.717525:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096695.717532:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096695.717538:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790096695.717587:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.717594:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790096695.718036:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1790096695.718060:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.718067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab572a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5731 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.718085:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096695.718087:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096695.718088:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.720927:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.720967:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fc00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096695.720972:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.720983:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096695.720990:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096695.720996:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790096695.721067:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721075:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096695.721114:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721122:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab5700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5707 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721141:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.721144:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.721147:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096695.721170:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324067712:0@lo:103: 00000100:00100000:3.0:1790096695.721240:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.721306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067712 00000100:00100000:3.0:1790096695.721315:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067712 00010000:00010000:3.0:1790096695.721345:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 15 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.721383:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790096695.721392:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3314:x1877052324067712:12345-0@lo:103: 00010000:00010000:3.0:1790096695.721407:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096695.721411:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 15 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721422:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 15 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721437:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac0031200/0xcc97d9eae5ab5707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5700 expref: 15 pid: 5845 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.721452:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096695.721487:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3314:x1877052324067712:12345-0@lo:103: Request processed in 96us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.721494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790096695.721534:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324067712:0@lo:103: 00000100:00100000:1.0:1790096695.723980:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324067584:0@lo:103: 00000100:00100000:1.0:1790096695.724091:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.724196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067584 00000100:00100000:3.0:1790096695.724212:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067584 00010000:00010000:3.0:1790096695.724256:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.724307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790096695.724317:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3316:x1877052324067584:12345-0@lo:103: 00010000:00010000:3.0:1790096695.724355:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096695.724361:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.724382:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.724400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486200/0xcc97d9eae5ab5731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab572a expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.724425:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096695.724504:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3316:x1877052324067584:12345-0@lo:103: Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.724511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790096695.724574:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324067584:0@lo:103: 00010000:00010000:2.0:1790096695.726102:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096695.726107:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096695.726109:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.726147:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.726159:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096695.726163:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.726172:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096695.726179:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096695.726185:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790096695.726233:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.726239:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096695.726267:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.726283:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab56d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.726315:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.726319:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096695.726324:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096695.726324:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324067840:0@lo:103: 00000100:00100000:1.0:1790096695.726467:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.731195:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067840 00000100:00100000:3.0:1790096695.731216:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067840 00010000:00010000:2.0:1790096695.732740:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 13 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096695.732812:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790096695.732833:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3315:x1877052324067840:12345-0@lo:103: 00010000:00010000:2.0:1790096695.732850:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096695.732855:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 13 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732868:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 13 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732890:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab56dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab56d6 expref: 13 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732913:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732922:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732942:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732951:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732958:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732966:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732983:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096695.732987:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.732995:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.733016:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.733028:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096695.733125:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3315:x1877052324067840:12345-0@lo:103: Request processed in 295us (6658us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.733134:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790096695.733242:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324067840:0@lo:103: 00010000:00010000:3.0:1790096695.733742:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.733767:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.733776:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab578c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790096695.733798:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790096695.864675:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:7643:x1877052324066560:12345-0@lo:253: Request processed in 194298us (194640us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.864705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790096695.868198:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324066560:0@lo:253: 10000000:01000000:2.0:1790096695.868224:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790096695.868228:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790096695.868230:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790096695.868232:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790096695.868233:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790096695.868235:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790096695.868236:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790096695.868237:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790096695.868239:0:7643:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790096695.868240:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790096695.868242:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790096695.868275:0:7643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eaaff322800 from lustre-OST0001 10000000:01000000:2.0:1790096695.868314:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790096695.868318:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790096695.868328:0:7643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eaac97d4d40 local copy 10000000:01000000:2.0:1790096695.868333:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790096695.868403:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.868415:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.868427:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096695.868448:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324067968:0@lo:101: 00000100:00100000:2.0:1790096695.868531:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096695.868740:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccfcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790096695.869171:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096695.870306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324067968 00000100:00100000:3.0:1790096695.870320:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324067968 00000100:00100000:2.0:1790096695.870620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790096695.870632:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+11:7643:x1877052324067968:12345-0@lo:101: 00010000:00010000:2.0:1790096695.870672:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096695.870868:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab579a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5793 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.870910:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab579a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5793 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.870923:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab579a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5793 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.870933:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1539a00, rc 0) 00000100:00100000:2.0:1790096695.871032:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324067968:12345-0@lo:101: Request processed in 404us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.871039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790096695.871152:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324067968:0@lo:101: 00010000:00010000:3.0:1790096695.871175:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.871185:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096695.871338:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068096:0@lo:501: 00000100:00100000:3.0:1790096695.871384:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.871458:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e240 going to sleep for 11 seconds 00000100:00100000:0.0:1790096695.871485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068096 00000100:00100000:0.0:1790096695.871491:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068096 00000100:00100000:0.0:1790096695.871536:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790096695.871545:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068096:12345-0@lo:501: 00000100:00100000:0.0:1790096695.872244:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068096:12345-0@lo:501: Request processed in 697us (857us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096695.872254:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790096695.872318:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068096:0@lo:501: 10000000:01000000:3.0:1790096695.872339:0:7643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790096695.872371:0:7643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790096695.872378:0:7643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.872389:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.872397:0:7643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.872508:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790096695.872537:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eaaff322800 10000000:01000000:3.0:1790096695.872543:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790096695.872549:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790096695.872551:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790096695.872557:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790096695.872560:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790096695.872588:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.872596:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.872762:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.872867:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096695.872874:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.873005:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096695.873009:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.873019:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096695.873028:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096695.873035:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096695.873067:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.873074:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790096695.873124:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096695.873171:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068224:0@lo:101: 00000100:00100000:2.0:1790096695.873227:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096695.873264:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccf900 going to sleep for 11 seconds 00000100:00100000:2.0:1790096695.873282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068224 00000100:00100000:2.0:1790096695.873290:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068224 00000100:00100000:2.0:1790096695.873325:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790096695.873332:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068224:12345-0@lo:101: 00010000:00010000:2.0:1790096695.873344:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096695.873358:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab57a1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.873382:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.873393:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.873403:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1538000, rc 0) 00010000:00010000:0.0:1790096695.873486:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.873495:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab5793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc97d9eae5ab579a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.873509:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096695.873511:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096695.873512:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096695.873544:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324068352:0@lo:103: 00000100:00100000:3.0:1790096695.873601:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.874037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068352 00000100:00100000:0.0:1790096695.874044:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068352 00000100:00100000:0.0:1790096695.874087:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096695.874093:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3317:x1877052324068352:12345-0@lo:103: 00010000:00010000:0.0:1790096695.874106:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096695.874122:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab579a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5793 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.874134:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096695.874178:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3317:x1877052324068352:12345-0@lo:103: Request processed in 85us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.874186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096695.874223:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324068352:0@lo:103: 00000100:00100000:2.0:1790096695.874333:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068224:12345-0@lo:101: Request processed in 1000us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.874340:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790096695.875042:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068224:0@lo:101: 00010000:00010000:0.0:1790096695.875068:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.875080:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096695.875215:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068480:0@lo:501: 00000100:00100000:0.0:1790096695.875254:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.875332:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.875370:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068480 00000100:00100000:3.0:1790096695.875376:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068480 00000100:00100000:3.0:1790096695.875529:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790096695.875538:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068480:12345-0@lo:501: 00000100:00100000:3.0:1790096695.876178:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068480:12345-0@lo:501: Request processed in 638us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.876191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790096695.876208:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068480:0@lo:501: 00000100:00100000:0.0:1790096695.876247:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068608:0@lo:503: 00000100:00100000:0.0:1790096695.876292:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.876361:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096695.876396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068608 00000100:00100000:2.0:1790096695.876476:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068608 00000100:00100000:2.0:1790096695.876519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790096695.876527:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068608:12345-0@lo:503: 00000100:00100000:2.0:1790096695.877432:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068608:12345-0@lo:503: Request processed in 899us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.877444:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790096695.878074:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068608:0@lo:503: 00000040:00080000:2.0:1790096695.882375:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790096695.882548:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068736:0@lo:502: 00000100:00100000:2.0:1790096695.882684:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.883000:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccf900 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.884509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068736 00000100:00100000:3.0:1790096695.884526:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068736 00000100:00100000:3.0:1790096695.884608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790096695.884620:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068736:12345-0@lo:502: 00000100:00100000:3.0:1790096695.885167:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068736:12345-0@lo:502: Request processed in 546us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.885177:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790096695.888088:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068736:0@lo:502: 00000040:00080000:0.0:1790096695.888554:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790096695.888632:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790096695.888705:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790096695.888757:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790096695.888794:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790096695.888841:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790096695.888890:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068864:0@lo:502: 00000100:00100000:0.0:1790096695.888979:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.889031:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096695.889142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068864 00000100:00100000:2.0:1790096695.889151:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068864 00000100:00100000:2.0:1790096695.889207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790096695.889218:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068864:12345-0@lo:502: 00000100:00100000:2.0:1790096695.889444:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068864:12345-0@lo:502: Request processed in 227us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.889453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790096695.889695:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068864:0@lo:502: 00000040:00080000:1.0:1790096695.889832:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790096695.889852:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790096695.890876:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790096695.890891:0:7654:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790096695.890900:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096695.890903:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790096695.890911:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096695.890933:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eaad1863380) 00000020:00000080:1.0:1790096695.890961:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790096695.890967:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790096695.891049:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaaff322800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790096695.891058:0:7654:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790096695.891065:0:7654:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc97d9eae5ab57b6 00010000:00010000:1.0:1790096695.900210:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790096695.900894:0:7654:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790096695.906907:0:7654:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790096695.908867:0:7654:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1790096695.918406:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790096695.919851:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790096695.928223:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790096695.928243:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096695.928250:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096695.928253:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790096695.928258:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096695.928262:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096695.928264:0:7654:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790096695.928284:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790096695.928287:0:7654:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790096695.928368:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096695.928373:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096695.928374:0:7654:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790096695.928378:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790096695.928910:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790096695.928961:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790096695.928991:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.929006:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096695.929015:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff322800 from 1 10000000:01000000:2.0:1790096695.929136:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790096695.929192:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.929201:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096695.929215:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096695.929264:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068992:0@lo:101: 00000100:00100000:2.0:1790096695.929354:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096695.929401:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad578b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096695.930551:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324068992 00000100:00100000:1.0:1790096695.930563:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324068992 00000100:00100000:1.0:1790096695.930632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790096695.930664:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:7643:x1877052324068992:12345-0@lo:101: 00010000:00010000:1.0:1790096695.930685:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096695.930707:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab57bd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.930749:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.930774:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.930786:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1486400, rc 0) 00000100:00100000:1.0:1790096695.930886:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324068992:12345-0@lo:101: Request processed in 225us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.930893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790096695.931093:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324068992:0@lo:101: 00010000:00010000:0.0:1790096695.931116:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.931126:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096695.931268:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069120:0@lo:501: 00000100:00100000:0.0:1790096695.931308:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.931344:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096695.932618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069120 00000100:00100000:1.0:1790096695.932631:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069120 00000100:00100000:1.0:1790096695.932692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790096695.932700:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069120:12345-0@lo:501: 00000100:00100000:0.0:1790096695.933853:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069120:12345-0@lo:501: Request processed in 1146us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.933865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790096695.934055:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069120:0@lo:501: 00000100:00100000:2.0:1790096695.934121:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069248:0@lo:503: 00000100:00100000:2.0:1790096695.934178:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096695.934222:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad578b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096695.934374:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069248 00000100:00100000:1.0:1790096695.934381:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069248 00000100:00100000:1.0:1790096695.934657:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790096695.934669:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069248:12345-0@lo:503: 00000100:00100000:1.0:1790096695.936692:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069248:12345-0@lo:503: Request processed in 2016us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.936705:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790096695.936934:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069248:0@lo:503: 00000040:00080000:3.0:1790096695.940144:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790096695.940298:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069376:0@lo:502: 00000100:00100000:3.0:1790096695.940407:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.940571:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096695.940879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069376 00000100:00100000:0.0:1790096695.940891:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069376 00000100:00100000:0.0:1790096695.940951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790096695.940961:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069376:12345-0@lo:502: 00000100:00100000:0.0:1790096695.941365:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069376:12345-0@lo:502: Request processed in 404us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.941373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790096695.942025:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069376:0@lo:502: 00000040:00080000:3.0:1790096695.942408:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790096695.945704:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790096695.945792:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069504:0@lo:502: 00000100:00100000:3.0:1790096695.945916:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.946224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069504 00000100:00100000:1.0:1790096695.946235:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069504 00000100:00100000:1.0:1790096695.946304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790096695.946316:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069504:12345-0@lo:502: 00000100:00100000:1.0:1790096695.946806:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069504:12345-0@lo:502: Request processed in 490us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.946830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790096695.946959:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.947251:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069504:0@lo:502: 00000040:00080000:3.0:1790096695.948866:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790096695.948903:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790096695.951138:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096695.951157:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096695.951160:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790096695.951172:0:7658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaaff322800 00000020:00000080:3.0:1790096695.951174:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790096695.951196:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096695.951200:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096695.951201:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790096695.951204:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790096695.951489:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790096695.951529:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096695.951558:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.951572:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096695.951627:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790096695.951630:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eaaff322800 10000000:01000000:1.0:1790096695.951664:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eaaff322800 10000000:01000000:1.0:1790096695.951670:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790096695.951677:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaaff322800 from 1 10000000:01000000:1.0:1790096695.951680:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790096695.951726:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.951735:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.951748:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096695.951775:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069632:0@lo:101: 00000100:00100000:1.0:1790096695.951874:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.951927:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.952065:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069632 00000100:00100000:3.0:1790096695.952075:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069632 00000100:00100000:3.0:1790096695.952195:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790096695.952207:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324069632:12345-0@lo:101: 00010000:00010000:3.0:1790096695.952226:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096695.952243:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab57cb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.952271:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.952282:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096695.952292:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f600, rc 0) 00000100:00100000:3.0:1790096695.952346:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324069632:12345-0@lo:101: Request processed in 142us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.952354:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790096695.953105:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069632:0@lo:101: 00010000:00010000:1.0:1790096695.953129:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096695.953150:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096695.953315:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069760:0@lo:501: 00000100:00100000:1.0:1790096695.953357:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.953390:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069760 00000100:00100000:1.0:1790096695.953395:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069760 00000100:00100000:1.0:1790096695.953589:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790096695.953597:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324069760:12345-0@lo:501: 00000100:00100000:1.0:1790096695.953922:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324069760:12345-0@lo:501: Request processed in 324us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.953930:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790096695.953963:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096695.953977:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069760:0@lo:501: 00000100:00100000:1.0:1790096695.954008:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069888:0@lo:503: 00000100:00100000:1.0:1790096695.954051:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.954076:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324069888 00000100:00100000:1.0:1790096695.954080:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324069888 00000100:00100000:1.0:1790096695.954772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790096695.954783:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324069888:12345-0@lo:503: 00000100:00100000:1.0:1790096695.955001:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324069888:12345-0@lo:503: Request processed in 220us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.955009:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790096695.955056:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096695.955074:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324069888:0@lo:503: 00000040:00080000:1.0:1790096695.957706:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790096695.957834:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070016:0@lo:502: 00000100:00100000:1.0:1790096695.957935:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096695.957991:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.958622:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070016 00000100:00100000:3.0:1790096695.958659:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070016 00000100:00100000:3.0:1790096695.958724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790096695.958739:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324070016:12345-0@lo:502: 00000100:00100000:3.0:1790096695.959050:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324070016:12345-0@lo:502: Request processed in 316us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096695.959736:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070016:0@lo:502: 00000040:00080000:1.0:1790096695.960114:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790096695.960181:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790096695.960208:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790096695.960246:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790096695.960277:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790096695.960315:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790096695.960343:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790096695.960368:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000100:00100000:3.0:1790096695.961673:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000040:00080000:1.0:1790096695.962040:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790096695.962150:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790096695.962187:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790096695.962256:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790096695.962292:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790096695.962321:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790096695.962364:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790096695.962400:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790096695.963196:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790096695.963281:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790096695.963322:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790096695.963357:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790096695.963484:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790096695.964097:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790096695.964141:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790096695.964204:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790096695.964251:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790096695.964282:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790096695.964312:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790096695.964789:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790096695.964859:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790096695.964915:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790096695.964953:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790096695.965001:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790096695.965035:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790096695.965303:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790096695.965350:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790096695.965427:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790096695.965469:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790096695.965960:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070144:0@lo:502: 00000100:00100000:0.0:1790096695.966142:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.966225:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790096695.966266:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070144 00000100:00100000:3.0:1790096695.966273:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070144 00000100:00100000:3.0:1790096695.966329:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790096695.966344:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324070144:12345-0@lo:502: 00000100:00100000:3.0:1790096695.967092:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324070144:12345-0@lo:502: Request processed in 738us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.967103:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790096695.967251:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070144:0@lo:502: 00000040:00080000:0.0:1790096695.967353:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790096695.967369:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790096695.968712:0:7659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790096695.968734:0:7659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eaaef59b380) 00000020:00000080:3.0:1790096695.968761:0:7659:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1790096695.968857:0:7659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaaff322800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790096695.968862:0:7659:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaaff322800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790096695.968865:0:7659:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaaff322800 3 00010000:00080000:3.0:1790096695.968901:0:7659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaad0eb9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790096695.971524:0:7659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1790096695.971884:0:7659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790096695.971937:0:7659:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790096695.971954:0:7659:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcc97d9eae5ab57e0 00000100:00080000:3.0:1790096695.971968:0:7659:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790096695.971993:0:7659:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eaad0eb9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096695.972042:0:7659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b42680 x1877052324070272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790096695.972088:0:7659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790096695.972161:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324070272:0@lo:38: 00000100:00100000:0.0:1790096695.972254:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.972325:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070272 00000100:00100000:0.0:1790096695.972332:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070272 00000100:00100000:0.0:1790096695.972373:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096695.972381:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324070272:12345-0@lo:38: 00010000:00080000:0.0:1790096695.972411:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1790096695.972449:0:5851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc97d9eae5ab57e7 00000004:00100000:0.0:1790096695.972467:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790096695.972505:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9eaaeef5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096695.972577:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877052324070272:12345-0@lo:38: Request processed in 194us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.972585:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790096695.972660:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b42680 x1877052324070272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096695.972672:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790096695.972684:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790096695.972692:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790096695.972697:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790096695.972699:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790096695.972705:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324070272:0@lo:38: 00000040:00080000:0.0:1790096695.973489:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1790096695.973621:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790096695.973682:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790096695.973702:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096695.973714:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790096695.973787:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790096695.973790:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790096695.973791:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096695.973792:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096695.973794:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096695.973795:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096695.973797:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096695.973798:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096695.973799:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096695.973801:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096695.973802:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790096695.973820:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790096695.973823:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790096695.973825:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790096695.973826:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096695.973827:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096695.973828:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096695.973829:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096695.973830:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096695.973831:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096695.973832:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096695.973833:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096695.973834:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790096695.973862:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790096695.973879:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070400:0@lo:253: 00000100:00100000:0.0:1790096695.973941:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.973993:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070400 00000100:00100000:0.0:1790096695.974001:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070400 00000100:00100000:0.0:1790096695.974043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790096695.974052:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:7643:x1877052324070400:12345-0@lo:253: 00000100:00100000:3.0:1790096695.974232:0:7660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1877052324070528:0@lo:901: 00000100:00100000:3.0:1790096695.974272:0:7660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096695.974320:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070528 00000100:00100000:3.0:1790096695.974325:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070528 00000100:00100000:3.0:1790096695.974368:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096695.974376:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1877052324070528:12345-0@lo:901: 00000100:00100000:3.0:1790096695.974842:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1877052324070528:12345-0@lo:901: Request processed in 465us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096695.974850:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790096695.974876:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096695.974892:0:7660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2ec00 going to sleep for 11 seconds 00010000:00080000:3.0:1790096695.974917:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b43480 x1877052324070528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790096711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096695.974931:0:7660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1877052324070528:0@lo:901: 20000000:01000000:0.0:1790096695.975253:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790096695.975278:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790096695.975735:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790096695.977458:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324070912:0@lo:400: 00000100:00100000:0.0:1790096695.977539:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.977594:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096695.977600:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324070784:0@lo:400: 00000100:00100000:0.0:1790096695.977628:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.977689:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070784 00000100:00100000:0.0:1790096695.977698:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070784 00000100:00100000:0.0:1790096695.977773:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790096695.977782:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324070784:12345-0@lo:400: 00000100:00100000:0.0:1790096695.977858:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324070784:12345-0@lo:400: Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.977879:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1790096695.977904:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790096695.977937:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b78380 x1877052324070784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096695.977951:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324070784:0@lo:400: 00000100:00100000:2.0:1790096695.978316:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070912 00000100:00100000:2.0:1790096695.978322:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070912 00000100:00100000:2.0:1790096695.978367:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096695.978376:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324070912:12345-0@lo:400: 00000100:00100000:2.0:1790096695.978421:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324070912:12345-0@lo:400: Request processed in 47us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096695.978427:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790096695.980178:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790096695.980238:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b7b100 x1877052324070912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096695.980256:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324070912:0@lo:400: 00000100:00100000:2.0:1790096695.981714:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096695.981746:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324070656:0@lo:400: 00000100:00100000:2.0:1790096695.981843:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096695.982331:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324070656 00000100:00100000:0.0:1790096695.982343:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324070656 00000100:00100000:0.0:1790096695.982406:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790096695.982417:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324070656:12345-0@lo:400: 00000100:00100000:0.0:1790096695.982496:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324070656:12345-0@lo:400: Request processed in 80us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096695.982503:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790096695.982557:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b7a680 x1877052324070656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096695.982571:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324070656:0@lo:400: 20000000:01000000:2.0:1790096696.021944:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790096696.021969:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790096696.022041:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790096696.022048:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790096696.022077:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.022110:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.022119:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.022171:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.022206:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096696.022225:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324071040:0@lo:104: 00000100:00100000:3.0:1790096696.022312:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096696.022369:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e000 going to sleep for 11 seconds 00000100:00100000:2.0:1790096696.022550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071040 00000100:00100000:2.0:1790096696.022560:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071040 00000100:00100000:2.0:1790096696.022628:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096696.022662:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324071040:12345-0@lo:104: 00010000:00010000:2.0:1790096696.022678:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022759:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790096696.022765:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:5867:x1877052324071040:12345-0@lo:104: Request processed in 106us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096696.022773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790096696.022799:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096696.022807:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022826:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096696.022831:0:7651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022841:0:7651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096696.022849:0:7651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096696.022856:0:7651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790096696.022891:0:7651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022898:0:7651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096696.022917:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022925:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148e400/0xcc97d9eae5ab5738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab573f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.022953:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096696.022955:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096696.022957:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096696.022970:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324071168:0@lo:103: 00000100:00100000:2.0:1790096696.023006:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096696.023050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071168 00000100:00100000:2.0:1790096696.023054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071168 00010000:00010000:2.0:1790096696.023073:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 15 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096696.023170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096696.023177:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3316:x1877052324071168:12345-0@lo:103: 00010000:00010000:2.0:1790096696.023191:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096696.023195:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 15 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023206:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 15 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023226:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023234:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790096696.023250:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008038926s 00010000:00010000:2.0:1790096696.023254:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023273:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023280:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023286:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023292:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fc00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096696.023296:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023304:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023313:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096696.023322:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096696.023352:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3316:x1877052324071168:12345-0@lo:103: Request processed in 176us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096696.023359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096696.023426:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324071168:0@lo:103: 00010000:00010000:3.0:1790096696.023686:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab573f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5738 expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096696.023699:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1877052324071040:0@lo:104: 00010000:00010000:3.0:1790096696.023716:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.023726:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.023732:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096696.023738:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab57ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096696.036981:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:7643:x1877052324070400:12345-0@lo:253: Request processed in 62915us (63024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096696.036998:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790096696.037118:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:7643:1877052324070400:0@lo:253: 10000000:01000000:0.0:1790096696.037139:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790096696.037142:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096696.037144:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790096696.037145:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096696.037146:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096696.037168:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096696.037169:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096696.037171:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096696.037172:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790096696.037174:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790096696.037176:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096696.037177:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790096696.037197:0:7643:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790096696.045593:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790096696.047094:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790096696.047418:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790096696.047609:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096696.051174:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096696.051900:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790096696.053276:0:7643:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790096696.374261:0:7643:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790096696.374273:0:7643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790096696.374333:0:7643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790096696.374410:0:7643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790096696.374426:0:7643:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790096696.374457:0:7643:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790096696.892935:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096697.215838:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324071296:0@lo:13: 00000100:00100000:3.0:1790096697.215943:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096697.216094:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071296 00000100:00100000:2.0:1790096697.216108:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071296 00000100:00100000:2.0:1790096697.216242:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096697.216262:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324071296:12345-0@lo:13: 00002000:00000024:2.0:1790096697.216307:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096697.216358:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324071296:12345-0@lo:13: Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096697.216366:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790096697.216627:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7aa00 x1877052324071296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096697.216765:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324071296:0@lo:13: 00000100:00080000:1.0:1790096697.216966:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790096697.916934:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096698.940945:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096699.965286:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096700.988785:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096701.311021:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324071424:0@lo:400: 00000100:00100000:0.0:1790096701.311144:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324071552:0@lo:400: 00000100:00100000:0.0:1790096701.311227:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096701.311315:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071552 00000100:00100000:0.0:1790096701.311323:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071552 00000100:00100000:0.0:1790096701.311379:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096701.311389:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324071552:12345-0@lo:400: 00000100:00100000:0.0:1790096701.311443:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324071552:12345-0@lo:400: Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096701.311450:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790096701.311752:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7bb80 x1877052324071552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096701.311767:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324071552:0@lo:400: 00000100:00100000:2.0:1790096701.312517:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096701.312567:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324071936:0@lo:400: 00000100:00100000:2.0:1790096701.312601:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096701.312651:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324071808:0@lo:400: 00000100:00100000:2.0:1790096701.312688:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096701.312709:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096701.312715:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324071680:0@lo:400: 00000100:00100000:2.0:1790096701.312737:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096701.312764:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071808 00000100:00100000:2.0:1790096701.312770:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071808 00000100:00100000:2.0:1790096701.312832:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096701.312840:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324071808:12345-0@lo:400: 00000100:00100000:2.0:1790096701.312888:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324071808:12345-0@lo:400: Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096701.312895:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790096701.312930:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b78000 x1877052324071808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096701.312942:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324071808:0@lo:400: 00000100:00080000:1.0:1790096701.313472:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096701.314933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071424 00000100:00100000:0.0:1790096701.314945:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071424 00000100:00100000:0.0:1790096701.315573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790096701.315586:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3314:x1877052324071424:12345-0@lo:400: 00000100:00100000:0.0:1790096701.315718:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3314:x1877052324071424:12345-0@lo:400: Request processed in 136us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096701.315735:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790096701.315963:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324071424:0@lo:400: 00000100:00100000:0.0:1790096701.316077:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071936 00000100:00100000:0.0:1790096701.316083:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071936 00000100:00100000:0.0:1790096701.316491:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324071680 00000100:00100000:0.0:1790096701.316497:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324071680 00000100:00080000:3.0:1790096701.316521:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096701.316600:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096701.316609:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324071936:12345-0@lo:400: 00000100:00100000:0.0:1790096701.316684:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324071936:12345-0@lo:400: Request processed in 76us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096701.316691:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096701.316705:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096701.316712:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324071680:12345-0@lo:400: 00000100:00100000:0.0:1790096701.316749:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324071680:12345-0@lo:400: Request processed in 38us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096701.316755:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790096701.316817:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7b480 x1877052324071936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096701.316830:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324071936:0@lo:400: 00010000:00080000:0.0:1790096701.316862:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b78a80 x1877052324071680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096701.316873:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324071680:0@lo:400: 00010000:00010000:2.0:1790096702.012792:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096702.333995:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324072064:0@lo:13: 00000100:00100000:0.0:1790096702.340094:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096702.340268:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072064 00000100:00100000:1.0:1790096702.340292:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072064 00000100:00100000:1.0:1790096702.340340:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790096702.340352:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324072064:12345-0@lo:13: 00002000:00000024:1.0:1790096702.340387:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096702.340473:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324072064:12345-0@lo:13: Request processed in 123us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096702.340480:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790096702.340543:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b42d80 x1877052324072064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096702.340564:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324072064:0@lo:13: 00010000:00010000:0.0:1790096703.038007:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790096703.311147:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790096704.060890:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790096704.380802:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790096704.380827:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac4279800 from 30 10000000:01000000:0.0:1790096704.380833:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790096704.380889:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.380899:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.380910:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.380933:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072192:0@lo:101: 00000100:00100000:0.0:1790096704.381003:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.381061:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.381118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072192 00000100:00100000:3.0:1790096704.381125:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072192 00000100:00100000:3.0:1790096704.381176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790096704.381187:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324072192:12345-0@lo:101: 00010000:00010000:3.0:1790096704.381200:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096704.381213:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab57f5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.381234:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.381244:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.381253:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f200, rc 0) 00000100:00100000:3.0:1790096704.381297:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072192:12345-0@lo:101: Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.381310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790096704.381365:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072192:0@lo:101: 00010000:00010000:3.0:1790096704.381382:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.381391:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096704.381457:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072320:0@lo:501: 00000100:00100000:3.0:1790096704.381484:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.381500:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.381513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072320 00000100:00100000:3.0:1790096704.381517:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072320 00000100:00100000:3.0:1790096704.381538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790096704.381544:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072320:12345-0@lo:501: 00000100:00100000:3.0:1790096704.381926:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072320:12345-0@lo:501: Request processed in 381us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.381933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790096704.382348:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072320:0@lo:501: 00000100:00100000:3.0:1790096704.382380:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072448:0@lo:503: 00000100:00100000:3.0:1790096704.382420:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.382436:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.382449:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072448 00000100:00100000:3.0:1790096704.382453:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072448 00000100:00100000:3.0:1790096704.382477:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790096704.382483:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072448:12345-0@lo:503: 00000100:00100000:3.0:1790096704.382800:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072448:12345-0@lo:503: Request processed in 315us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.382807:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790096704.382852:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072448:0@lo:503: 00000100:00100000:3.0:1790096704.383027:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8064:1877052324072576:0@lo:502: 00000100:00100000:3.0:1790096704.383062:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.383083:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072576 00000100:00100000:3.0:1790096704.383088:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072576 00000100:00100000:3.0:1790096704.383110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790096704.383116:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8064:x1877052324072576:12345-0@lo:502: 00000100:00100000:3.0:1790096704.383328:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8064:x1877052324072576:12345-0@lo:502: Request processed in 211us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.383335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790096704.383367:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.383379:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8064:1877052324072576:0@lo:502: 00000100:00100000:3.0:1790096704.383419:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8064:1877052324072704:0@lo:502: 00000100:00100000:3.0:1790096704.383451:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.383476:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.384160:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072704 00000100:00100000:0.0:1790096704.384168:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072704 00000100:00100000:0.0:1790096704.384307:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790096704.384318:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8064:x1877052324072704:12345-0@lo:502: 00000100:00100000:0.0:1790096704.384543:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8064:x1877052324072704:12345-0@lo:502: Request processed in 228us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.384552:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790096704.384673:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8064:1877052324072704:0@lo:502: 00000040:00080000:1.0:1790096704.384704:0:8064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790096704.385105:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790096704.385125:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790096704.385135:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.385147:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096704.385157:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790096704.385167:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790096704.385170:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790096704.385199:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.385208:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.385216:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.385233:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072832:0@lo:101: 00000100:00100000:0.0:1790096704.385272:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.385311:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.385984:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072832 00000100:00100000:1.0:1790096704.385992:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072832 00000100:00100000:1.0:1790096704.386039:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790096704.386048:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324072832:12345-0@lo:101: 00010000:00010000:1.0:1790096704.386059:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096704.386073:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5803 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.386097:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.386108:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.386117:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1487400, rc 0) 00000100:00100000:1.0:1790096704.386171:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324072832:12345-0@lo:101: Request processed in 124us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.386236:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072832:0@lo:101: 00010000:00010000:0.0:1790096704.386252:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.386261:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.386311:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072960:0@lo:501: 00000100:00100000:0.0:1790096704.386343:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.386368:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.386382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324072960 00000100:00100000:0.0:1790096704.386385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324072960 00000100:00100000:0.0:1790096704.386409:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790096704.386416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324072960:12345-0@lo:501: 00000100:00100000:0.0:1790096704.386680:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324072960:12345-0@lo:501: Request processed in 264us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.386693:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790096704.386732:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324072960:0@lo:501: 00000100:00100000:0.0:1790096704.386771:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073088:0@lo:503: 00000100:00100000:0.0:1790096704.386812:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.386846:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.386860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073088 00000100:00100000:0.0:1790096704.386864:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073088 00000100:00100000:1.0:1790096704.386900:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790096704.389381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790096704.389395:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324073088:12345-0@lo:503: 00000100:00100000:0.0:1790096704.389817:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324073088:12345-0@lo:503: Request processed in 425us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.389825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790096704.393380:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073088:0@lo:503: 00000100:00100000:1.0:1790096704.393891:0:8067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8067:1877052324073216:0@lo:502: 00000100:00100000:1.0:1790096704.394772:0:8067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.394818:0:8067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.395213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073216 00000100:00100000:3.0:1790096704.395221:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073216 00000100:00100000:3.0:1790096704.395269:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790096704.395279:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8067:x1877052324073216:12345-0@lo:502: 00000100:00100000:3.0:1790096704.395547:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8067:x1877052324073216:12345-0@lo:502: Request processed in 269us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.395556:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790096704.398803:0:8067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8067:1877052324073216:0@lo:502: 00000020:01000000:1.0:1790096704.398851:0:8067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096704.398863:0:8067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096704.398866:0:8067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790096704.398874:0:8067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790096704.398877:0:8067:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790096704.398909:0:8067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8067:1877052324073344:0@lo:502: 00000100:00100000:1.0:1790096704.398991:0:8067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.399027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073344 00000100:00100000:1.0:1790096704.399033:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073344 00000100:00100000:1.0:1790096704.399077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790096704.399086:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8067:x1877052324073344:12345-0@lo:502: 00000100:00100000:1.0:1790096704.399305:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8067:x1877052324073344:12345-0@lo:502: Request processed in 219us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.399313:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790096704.399364:0:8067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.399375:0:8067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8067:1877052324073344:0@lo:502: 00000020:01000000:1.0:1790096704.399392:0:8067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096704.399396:0:8067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096704.399397:0:8067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790096704.399401:0:8067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790096704.399471:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790096704.399493:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790096704.399502:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.399513:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096704.399522:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790096704.399525:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac41f3800 from 30 10000000:01000000:1.0:1790096704.399527:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790096704.399549:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.399558:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.399567:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096704.399578:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073472:0@lo:101: 00000100:00100000:1.0:1790096704.399604:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.399617:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.401998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073472 00000100:00100000:3.0:1790096704.402011:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073472 00000100:00100000:3.0:1790096704.403674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790096704.403695:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324073472:12345-0@lo:101: 00010000:00010000:3.0:1790096704.403715:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096704.403736:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5811 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.403776:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.403787:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.403796:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e800, rc 0) 00000100:00100000:3.0:1790096704.404449:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324073472:12345-0@lo:101: Request processed in 758us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.404457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790096704.404846:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073472:0@lo:101: 00010000:00010000:1.0:1790096704.404867:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.404877:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096704.404955:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073600:0@lo:501: 00000100:00100000:1.0:1790096704.404989:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.405020:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.405034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073600 00000100:00100000:1.0:1790096704.405039:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073600 00000100:00100000:1.0:1790096704.405070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790096704.405077:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324073600:12345-0@lo:501: 00000100:00100000:1.0:1790096704.405341:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324073600:12345-0@lo:501: Request processed in 263us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.405349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790096704.405493:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073600:0@lo:501: 00000100:00100000:0.0:1790096704.405525:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073728:0@lo:503: 00000100:00100000:0.0:1790096704.405565:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.405590:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.406084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073728 00000100:00100000:1.0:1790096704.406089:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073728 00000100:00100000:1.0:1790096704.406131:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790096704.406138:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324073728:12345-0@lo:503: 00000100:00100000:1.0:1790096704.406310:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324073728:12345-0@lo:503: Request processed in 172us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.406317:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790096704.406369:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324073728:0@lo:503: 00000100:00100000:1.0:1790096704.406529:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8069:1877052324073856:0@lo:502: 00000100:00100000:1.0:1790096704.406567:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.406587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073856 00000100:00100000:1.0:1790096704.406591:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073856 00000100:00100000:1.0:1790096704.406614:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790096704.406622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8069:x1877052324073856:12345-0@lo:502: 00000100:00100000:1.0:1790096704.407005:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8069:x1877052324073856:12345-0@lo:502: Request processed in 383us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.407019:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790096704.407060:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.407072:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8069:1877052324073856:0@lo:502: 00000100:00100000:1.0:1790096704.407112:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8069:1877052324073984:0@lo:502: 00000100:00100000:1.0:1790096704.407151:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.407178:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.407280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324073984 00000100:00100000:0.0:1790096704.407284:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324073984 00000100:00100000:0.0:1790096704.407316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790096704.407323:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8069:x1877052324073984:12345-0@lo:502: 00000100:00100000:0.0:1790096704.407458:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8069:x1877052324073984:12345-0@lo:502: Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.407466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790096704.407617:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8069:1877052324073984:0@lo:502: 00000040:00080000:1.0:1790096704.408407:0:8069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790096704.408592:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790096704.408610:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790096704.408627:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.408668:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096704.408678:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790096704.408680:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eaac41f3800 from 5 10000000:01000000:0.0:1790096704.408683:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790096704.408715:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.408724:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.408734:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.408761:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074112:0@lo:101: 00000100:00100000:0.0:1790096704.408805:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.408837:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.408939:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074112 00000100:00100000:1.0:1790096704.408954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074112 00000100:00100000:1.0:1790096704.408991:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790096704.408999:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324074112:12345-0@lo:101: 00010000:00010000:1.0:1790096704.409010:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096704.409023:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab5826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab581f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.409044:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab5826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab581f expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.409056:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab5826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab581f expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.409064:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1486800, rc 0) 00000100:00100000:1.0:1790096704.409102:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324074112:12345-0@lo:101: Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.409108:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790096704.409145:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074112:0@lo:101: 00010000:00010000:1.0:1790096704.409166:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.409175:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096704.409221:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074240:0@lo:256: 00000100:00100000:1.0:1790096704.409253:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.409447:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074240 00000100:00100000:0.0:1790096704.409452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074240 00000100:00100000:0.0:1790096704.409480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790096704.409487:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324074240:12345-0@lo:256: 20000000:01000000:0.0:1790096704.409500:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790096704.409516:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790096704.409519:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790096704.409555:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.415152:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324074240:12345-0@lo:256: Request processed in 5657us (5890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.415178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790096704.415332:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074240:0@lo:256: 10000000:01000000:1.0:1790096704.415394:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790096704.415403:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.415414:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096704.415424:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790096704.415427:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790096704.415429:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790096704.415470:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.415479:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096704.415489:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096704.415515:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074368:0@lo:101: 00000100:00100000:1.0:1790096704.415561:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.415600:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.415879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074368 00000100:00100000:0.0:1790096704.415886:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074368 00000100:00100000:0.0:1790096704.415929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790096704.415936:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324074368:12345-0@lo:101: 00010000:00010000:0.0:1790096704.415960:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096704.415973:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab582d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.415996:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.416008:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.416017:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac0031c00, rc 0) 00000100:00100000:0.0:1790096704.416054:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324074368:12345-0@lo:101: Request processed in 118us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.416060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790096704.421039:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074368:0@lo:101: 00010000:00010000:3.0:1790096704.421069:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096704.421084:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096704.421157:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074496:0@lo:501: 00000100:00100000:3.0:1790096704.421230:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.421265:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a64180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096704.430019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074496 00000100:00100000:1.0:1790096704.430034:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074496 00000100:00100000:1.0:1790096704.430087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790096704.430097:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324074496:12345-0@lo:501: 00000100:00100000:1.0:1790096704.430531:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324074496:12345-0@lo:501: Request processed in 434us (9299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096704.430539:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790096704.430594:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074496:0@lo:501: 00000100:00100000:1.0:1790096704.431189:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074624:0@lo:503: 00000100:00100000:1.0:1790096704.431242:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.431283:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.433405:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074624 00000100:00100000:0.0:1790096704.433419:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074624 00000100:00100000:0.0:1790096704.433481:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790096704.433492:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324074624:12345-0@lo:503: 00000100:00100000:0.0:1790096704.434785:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324074624:12345-0@lo:503: Request processed in 1289us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.434798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790096704.435910:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324074624:0@lo:503: 00000100:00100000:0.0:1790096704.438140:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8071:1877052324074752:0@lo:502: 00000100:00100000:0.0:1790096704.438234:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.438275:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.439706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074752 00000100:00100000:0.0:1790096704.439720:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074752 00000100:00100000:0.0:1790096704.439781:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790096704.439791:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8071:x1877052324074752:12345-0@lo:502: 00000100:00100000:0.0:1790096704.441371:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8071:x1877052324074752:12345-0@lo:502: Request processed in 771us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.441385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790096704.441472:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8071:1877052324074752:0@lo:502: 00000020:01000000:0.0:1790096704.441505:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790096704.441512:0:8071:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790096704.441520:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096704.441523:0:8071:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790096704.441532:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790096704.441535:0:8071:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1790096704.441558:0:8071:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790096704.441561:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790096704.446982:0:8071:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eaac97d0000) 00000020:00000080:0.0:1790096704.447014:0:8071:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790096704.447032:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790096704.447136:0:8071:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790096704.447143:0:8071:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790096704.447151:0:8071:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab5842 00010000:00080000:0.0:1790096704.447325:0:8071:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaaff5d4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790096704.447862:0:8071:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1790096704.448338:0:8071:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1790096704.448417:0:8071:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790096704.449812:0:8071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096704.450069:0:8071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096704.450239:0:8071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1790096704.450397:0:8071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1790096704.455329:0:8072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790096704.455337:0:8072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790096704.470073:0:8071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790096704.470094:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790096704.470137:0:8071:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790096704.470162:0:8071:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab5849 00000100:00080000:3.0:1790096704.470172:0:8071:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790096704.470183:0:8071:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaff5d4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096704.470216:0:8071:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b41180 x1877052324074880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096704.470248:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324074880:0@lo:8: 00000100:00100000:3.0:1790096704.470344:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.470409:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324074880 00000100:00100000:3.0:1790096704.470417:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324074880 00000100:00100000:3.0:1790096704.470460:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790096704.470469:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1877052324074880:12345-0@lo:8: 00010000:00080000:3.0:1790096704.470495:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1790096704.470519:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab5850 00002000:00100000:3.0:1790096704.470533:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eaaeef58000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790096704.470537:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1790096704.470541:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790096704.470698:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790096704.470846:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790096704.470867:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9eaaeef5b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790096704.470919:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1877052324074880:12345-0@lo:8: Request processed in 450us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.470926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790096704.470989:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b41180 x1877052324074880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790096714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096704.470998:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790096704.471012:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790096704.471018:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790096704.471023:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790096704.471026:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790096704.471046:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790096704.471052:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324074880:0@lo:8: 00000004:00080000:0.0:1790096704.471058:0:8072:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1790096704.471077:0:8071:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1790096704.471164:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324075136:0@lo:400: 00000004:00080000:0.0:1790096704.471175:0:8072:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 234041538599ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790096704.471203:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.471233:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790096704.471239:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324075008:0@lo:400: 00000100:00100000:3.0:1790096704.471267:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.471299:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075136 00000100:00100000:3.0:1790096704.471304:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075136 00000100:00100000:3.0:1790096704.471349:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075008 00000100:00100000:3.0:1790096704.471352:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075008 00000100:00100000:3.0:1790096704.471380:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790096704.471388:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324075136:12345-0@lo:400: 00000100:00100000:3.0:1790096704.471429:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324075136:12345-0@lo:400: Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.471435:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790096704.471448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790096704.473153:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324075392:0@lo:400: 00000100:00100000:1.0:1790096704.473218:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096704.473245:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096704.473252:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324075264:0@lo:400: 00000100:00100000:1.0:1790096704.473276:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.473484:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324075008:12345-0@lo:400: 00000100:00100000:3.0:1790096704.473545:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324075008:12345-0@lo:400: Request processed in 70us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.473554:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790096704.473577:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075392 00000100:00100000:3.0:1790096704.473592:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075392 00000100:00100000:3.0:1790096704.473627:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790096704.473650:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324075392:12345-0@lo:400: 00000100:00100000:3.0:1790096704.473691:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324075392:12345-0@lo:400: Request processed in 57us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.473697:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790096704.473721:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790096704.473770:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b41180 x1877052324075008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096704.473784:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324075008:0@lo:400: 00010000:00080000:3.0:1790096704.473910:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b40000 x1877052324075136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096704.473920:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324075136:0@lo:400: 00010000:00080000:1.0:1790096704.474538:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b42d80 x1877052324075392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096704.474551:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324075392:0@lo:400: 00000020:01000000:3.0:1790096704.474662:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096704.474670:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096704.474672:0:8071:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790096704.474676:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096704.474681:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096704.474683:0:8071:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790096704.474686:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790096704.474688:0:8071:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790096704.474724:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8071:1877052324075520:0@lo:502: 00000100:00100000:3.0:1790096704.474886:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.474925:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075520 00000100:00100000:3.0:1790096704.474931:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075520 00000100:00100000:3.0:1790096704.475046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790096704.475057:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8071:x1877052324075520:12345-0@lo:502: 00000100:00100000:3.0:1790096704.475389:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8071:x1877052324075520:12345-0@lo:502: Request processed in 333us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.475407:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790096704.475592:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.475613:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8071:1877052324075520:0@lo:502: 00000020:01000000:3.0:1790096704.475665:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096704.475670:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096704.475672:0:8071:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790096704.475678:0:8071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790096704.477128:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790096704.477157:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790096704.477168:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477181:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096704.477191:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790096704.477194:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eaac97d4d40 from 1 10000000:01000000:0.0:1790096704.477197:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790096704.477249:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477258:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477269:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.477290:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324075648:0@lo:101: 00000100:00100000:0.0:1790096704.477348:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.477388:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac52f4300 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.477484:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075648 00000100:00100000:0.0:1790096704.477498:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075648 00000100:00100000:0.0:1790096704.477554:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790096704.477563:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324075648:12345-0@lo:101: 00010000:00010000:0.0:1790096704.477576:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096704.477588:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5857 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477611:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477702:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477712:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690e00, rc 0) 00000100:00100000:0.0:1790096704.477762:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324075648:12345-0@lo:101: Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096704.477769:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790096704.477814:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324075648:0@lo:101: 00010000:00010000:0.0:1790096704.477830:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.477838:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096704.477890:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324075776:0@lo:501: 00000100:00100000:0.0:1790096704.477916:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.477929:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5662480 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.477940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075776 00000100:00100000:0.0:1790096704.477943:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075776 00000100:00100000:0.0:1790096704.477969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790096704.477975:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324075776:12345-0@lo:501: 00000100:00100000:0.0:1790096704.478411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324075776:12345-0@lo:501: Request processed in 435us (493us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096704.478420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790096704.478456:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324075776:0@lo:501: 10000000:01000000:0.0:1790096704.478482:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790096704.478489:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096704.478497:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096704.478999:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075264 00000100:00100000:2.0:1790096704.479008:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075264 00000100:00100000:2.0:1790096704.479067:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096704.479077:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324075264:12345-0@lo:400: 00000100:00100000:2.0:1790096704.479137:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324075264:12345-0@lo:400: Request processed in 63us (5860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096704.479144:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790096704.479315:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790096704.479369:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b43100 x1877052324075264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096704.479381:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324075264:0@lo:400: 00000004:00080000:1.0:1790096704.508667:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790096704.533582:0:8073:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790096704.533613:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076032:0@lo:7: 00000100:00100000:2.0:1790096704.533713:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096704.533741:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096704.533766:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096704.533778:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324075904:0@lo:13: 00000100:00100000:2.0:1790096704.533804:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096704.533836:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076032 00000100:00100000:2.0:1790096704.533843:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076032 00000100:00100000:2.0:1790096704.533901:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096704.533910:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8073:x1877052324076032:12345-0@lo:7: 00000100:00080000:3.0:1790096704.537690:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096704.537714:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324075904 00000100:00100000:3.0:1790096704.537723:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324075904 00000100:00100000:3.0:1790096704.537781:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790096704.537791:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324075904:12345-0@lo:13: 00002000:00000024:3.0:1790096704.537826:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790096704.537908:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324075904:12345-0@lo:13: Request processed in 119us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.537915:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790096704.538527:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b78000 x1877052324075904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096704.538547:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324075904:0@lo:13: 00002000:00080000:2.0:1790096704.539900:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790096704.539906:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790096704.539989:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8073:x1877052324076032:12345-0@lo:7: Request processed in 6077us (6273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096704.540007:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790096704.540198:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7a680 x1877052324076032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790096720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096704.540212:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076032:0@lo:7: 00000004:00080000:3.0:1790096704.540224:0:8073:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790096704.540260:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076160:0@lo:5: 00000100:00100000:3.0:1790096704.540292:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.540320:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096704.540366:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076160 00000100:00100000:2.0:1790096704.540373:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076160 00000100:00100000:2.0:1790096704.540450:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096704.540459:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8073:x1877052324076160:12345-0@lo:5: 00002000:00080000:2.0:1790096704.540482:0:7012:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790096704.540486:0:7012:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790096704.540736:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8073:x1877052324076160:12345-0@lo:5: Request processed in 277us (441us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790096704.540743:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790096704.540831:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b40000 x1877052324076160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790096720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096704.540844:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076160:0@lo:5: 00000004:00080000:0.0:1790096704.540854:0:8073:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790096704.540880:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076288:0@lo:700: 00000100:00100000:0.0:1790096704.540905:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.540923:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac34163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096704.540936:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076288 00000100:00100000:0.0:1790096704.540940:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076288 00000100:00100000:0.0:1790096704.540977:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096704.540983:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8073:x1877052324076288:12345-0@lo:700: 00000100:00100000:0.0:1790096704.541023:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1877052324076416:0@lo:700: 00000100:00100000:0.0:1790096704.541051:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096704.541067:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac34160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096704.541798:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076416 00000100:00100000:3.0:1790096704.541805:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076416 00000100:00100000:3.0:1790096704.541842:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790096704.541859:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1877052324076416:12345-0@lo:700: 40000000:02000000:3.0:1790096704.573236:0:5858:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790096704.578525:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1877052324076416:12345-0@lo:700: Request processed in 36658us (37462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096704.578539:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790096704.581109:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaae8d6f480 x1877052324076416/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790096720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096704.581127:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1877052324076416:0@lo:700: 40000000:02000000:0.0:1790096704.581142:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1790096704.652246:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790096704.652265:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790096704.653565:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8073:x1877052324076288:12345-0@lo:700: Request processed in 112567us (112644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096704.653584:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790096704.653869:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafbca2300 x1877052324076288/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790096720 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096704.653881:0:8073:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790096704.653895:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076288:0@lo:700: 00000004:02000040:1.0:1790096704.690190:0:8073:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1790096704.693537:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076544:0@lo:5: 00000100:00100000:1.0:1790096704.693609:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096704.693887:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076544 00000100:00100000:3.0:1790096704.693896:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076544 00000100:00100000:3.0:1790096704.693948:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096704.693956:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8073:x1877052324076544:12345-0@lo:5: 00000100:00100000:1.0:1790096704.697409:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea99c0 going to sleep for 11 seconds 00002000:00080000:3.0:1790096704.699434:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790096704.699456:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790096704.703134:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8073:x1877052324076544:12345-0@lo:5: Request processed in 9172us (9519us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790096704.703147:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790096704.707309:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185ad80 x1877052324076544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790096720 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096704.707333:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1877052324076544:0@lo:5: 00000004:00080000:1.0:1790096704.707348:0:8073:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1790096705.084824:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096706.109838:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096707.133869:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096707.453508:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096707.453535:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324076672:0@lo:13: 00000100:00100000:1.0:1790096707.453618:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096707.454010:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076672 00000100:00100000:3.0:1790096707.454018:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076672 00000100:00100000:3.0:1790096707.454090:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790096707.454099:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324076672:12345-0@lo:13: 00002000:00000024:3.0:1790096707.454136:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096707.454200:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324076672:12345-0@lo:13: Request processed in 102us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096707.454207:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790096707.454604:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790096707.454724:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b41880 x1877052324076672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096707.454755:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324076672:0@lo:13: 00010000:00010000:0.0:1790096708.163576:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790096708.241471:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790096708.761230:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096708.761329:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305178752 00000100:00100000:2.0:1790096708.761339:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305178752 00000100:00100000:2.0:1790096708.761390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1790096708.761399:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2359:x1877052305178752:12345-192.168.203.11@tcp:250: 00010000:00080000:2.0:1790096708.761427:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from abd903c2-2249-402d-8b70-05d1ccf7fe60@192.168.203.11@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1790096708.761456:0:5844:0:(genops.c:1384:class_connect()) connect: client abd903c2-2249-402d-8b70-05d1ccf7fe60, cookie 0xcc97d9eae5ab5865 00000100:00080000:2.0:1790096708.763925:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9eaafb3c1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096708.764014:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+5:2359:x1877052305178752:12345-192.168.203.11@tcp:250: Request processed in 2614us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096708.764043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1790096708.774295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096708.775257:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305178880 00000100:00100000:3.0:1790096708.775269:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305178880 00000100:00100000:3.0:1790096708.775330:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:3.0:1790096708.775341:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+5:5587:x1877052305178880:12345-192.168.203.11@tcp:101: 00010000:00010000:3.0:1790096708.775356:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096708.775386:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820dbf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.775415:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.775426:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.775435:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f000, rc 0) 00000100:00100000:3.0:1790096708.775494:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+6:5587:x1877052305178880:12345-192.168.203.11@tcp:101: Request processed in 156us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096708.775502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:3.0:1790096708.792430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.792810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179008 00000100:00100000:1.0:1790096708.792820:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179008 00000100:00100000:1.0:1790096708.792870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:1.0:1790096708.792879:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+6:5587:x1877052305179008:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1790096708.793245:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+6:5587:x1877052305179008:12345-192.168.203.11@tcp:501: Request processed in 366us (824us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790096708.793255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:3.0:1790096708.799355:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096708.799399:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179136 00000100:00100000:3.0:1790096708.799410:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179136 00000100:00100000:3.0:1790096708.799457:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1790096708.799466:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+6:5587:x1877052305179136:12345-192.168.203.11@tcp:101: 00010000:00010000:3.0:1790096708.799481:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096708.799497:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820dc6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.799539:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.799552:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096708.799577:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e400, rc 0) 00000100:00100000:3.0:1790096708.799656:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+7:5587:x1877052305179136:12345-192.168.203.11@tcp:101: Request processed in 190us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096708.799664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:2.0:1790096708.812611:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.812834:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179264 00000100:00100000:1.0:1790096708.812844:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179264 00000100:00100000:1.0:1790096708.812892:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:1.0:1790096708.812901:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+7:5587:x1877052305179264:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1790096708.813163:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5587:x1877052305179264:12345-192.168.203.11@tcp:501: Request processed in 262us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.813171:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790096708.820795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.820892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179392 00000100:00100000:1.0:1790096708.820902:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179392 00000100:00100000:1.0:1790096708.820957:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790096708.820967:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5587:x1877052305179392:12345-192.168.203.11@tcp:503: 00000100:00100000:1.0:1790096708.821342:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5587:x1877052305179392:12345-192.168.203.11@tcp:503: Request processed in 375us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.821352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790096708.827806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096708.829674:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179520 00000100:00100000:2.0:1790096708.829689:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179520 00000100:00100000:2.0:1790096708.829780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:2.0:1790096708.829790:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5605:x1877052305179520:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790096708.830168:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5605:x1877052305179520:12345-192.168.203.11@tcp:502: Request processed in 379us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096708.830177:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1790096708.852796:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096708.852831:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179648 00000100:00100000:0.0:1790096708.852840:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179648 00000100:00100000:0.0:1790096708.852888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1790096708.852899:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5605:x1877052305179648:12345-192.168.203.11@tcp:502: 00000100:00100000:0.0:1790096708.853440:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5605:x1877052305179648:12345-192.168.203.11@tcp:502: Request processed in 541us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096708.853460:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:1.0:1790096708.856530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096708.856627:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179776 00000100:00100000:2.0:1790096708.856679:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179776 00000100:00100000:2.0:1790096708.856742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:2.0:1790096708.856753:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5587:x1877052305179776:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1790096708.856769:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096708.856786:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab587a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820df0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096708.856812:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df0 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096708.856822:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df0 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096708.856830:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1538200, rc 0) 00000100:00100000:2.0:1790096708.856893:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5587:x1877052305179776:12345-192.168.203.11@tcp:101: Request processed in 141us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096708.856911:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1790096708.864916:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096708.865162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305179904 00000100:00100000:2.0:1790096708.865172:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305179904 00000100:00100000:2.0:1790096708.865227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1790096708.865238:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5587:x1877052305179904:12345-192.168.203.11@tcp:256: 20000000:01000000:2.0:1790096708.865264:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790096708.865290:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790096708.865294:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790096708.865298:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790096708.865300:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1790096708.870356:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5587:x1877052305179904:12345-192.168.203.11@tcp:256: Request processed in 5110us (5441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.870370:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:3.0:1790096708.885430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.885502:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180032 00000100:00100000:1.0:1790096708.885512:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180032 00000100:00100000:1.0:1790096708.885559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:1.0:1790096708.885568:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5587:x1877052305180032:12345-192.168.203.11@tcp:101: 00010000:00010000:1.0:1790096708.885582:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096708.885608:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820df7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096708.885663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096708.885696:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096708.885705:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b800, rc 0) 00000100:00100000:1.0:1790096708.885766:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5587:x1877052305180032:12345-192.168.203.11@tcp:101: Request processed in 199us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.885773:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790096708.889286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.889477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180160 00000100:00100000:1.0:1790096708.889488:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180160 00000100:00100000:1.0:1790096708.889546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790096708.889557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5587:x1877052305180160:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1790096708.889905:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5587:x1877052305180160:12345-192.168.203.11@tcp:501: Request processed in 348us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.889914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1790096708.894454:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096708.894518:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180288 00000100:00100000:2.0:1790096708.894529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180288 00000100:00100000:2.0:1790096708.894609:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:2.0:1790096708.894620:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5587:x1877052305180288:12345-192.168.203.11@tcp:503: 00000100:00100000:2.0:1790096708.895008:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5587:x1877052305180288:12345-192.168.203.11@tcp:503: Request processed in 388us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096708.895016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1790096708.902806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.902905:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180416 00000100:00100000:1.0:1790096708.902915:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180416 00000100:00100000:1.0:1790096708.903003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790096708.903018:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5611:x1877052305180416:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1790096708.903322:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5611:x1877052305180416:12345-192.168.203.11@tcp:502: Request processed in 308us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.903331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790096708.910254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096708.910334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180544 00000100:00100000:3.0:1790096708.910347:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180544 00000100:00100000:3.0:1790096708.910403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1790096708.910413:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5611:x1877052305180544:12345-192.168.203.11@tcp:502: 00000100:00100000:3.0:1790096708.910819:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5611:x1877052305180544:12345-192.168.203.11@tcp:502: Request processed in 405us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096708.910827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1790096708.915378:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096708.916033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180672 00000100:00100000:1.0:1790096708.916045:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180672 00000100:00100000:1.0:1790096708.916095:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790096708.916103:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1877052305180672:12345-192.168.203.11@tcp:38: 00010000:00080000:1.0:1790096708.916140:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1790096708.916185:0:5851:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab5888 00000004:00100000:1.0:1790096708.916363:0:5851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790096708.916370:0:5851:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1790096708.959148:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9eaaff216800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790096708.959234:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305180672:12345-192.168.203.11@tcp:38: Request processed in 43130us (43865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096708.959245:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00010000:00010000:2.0:1790096709.180928:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096709.501431:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324076800:0@lo:400: 00000100:00100000:2.0:1790096709.501468:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324077056:0@lo:400: 00000100:00100000:2.0:1790096709.503268:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096709.503337:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096709.503347:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324077184:0@lo:400: 00000100:00100000:2.0:1790096709.503381:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096709.503420:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077184 00000100:00100000:2.0:1790096709.503428:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077184 00000100:00100000:3.0:1790096709.503710:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096709.503783:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077056 00000100:00100000:3.0:1790096709.503788:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077056 00000100:00100000:1.0:1790096709.504220:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324076928:0@lo:400: 00000100:00100000:1.0:1790096709.504256:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096709.504277:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324077440:0@lo:400: 00000100:00100000:1.0:1790096709.504299:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096709.504348:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076928 00000100:00100000:1.0:1790096709.504352:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076928 00000100:00100000:1.0:1790096709.504399:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790096709.504407:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324076928:12345-0@lo:400: 00000100:00100000:1.0:1790096709.504472:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324076928:12345-0@lo:400: Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.504479:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790096709.504504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324076800 00000100:00100000:1.0:1790096709.504508:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324076800 00000100:00100000:1.0:1790096709.504531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790096709.504536:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324076800:12345-0@lo:400: 00000100:00100000:1.0:1790096709.504620:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324076800:12345-0@lo:400: Request processed in 83us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.504627:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1790096709.504738:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b41880 x1877052324076928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096709.504751:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324076928:0@lo:400: 00000100:00100000:1.0:1790096709.504803:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077440 00000100:00100000:1.0:1790096709.504807:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077440 00000100:00100000:0.0:1790096709.508579:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324076800:0@lo:400: 00000100:00100000:0.0:1790096709.508594:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324077312:0@lo:400: 00000100:00100000:0.0:1790096709.508773:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096709.508836:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077312 00000100:00100000:0.0:1790096709.508842:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077312 00000100:00100000:1.0:1790096709.514851:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790096709.514867:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324077440:12345-0@lo:400: 00000100:00100000:1.0:1790096709.514961:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324077440:12345-0@lo:400: Request processed in 100us (10661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.514969:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790096709.515009:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff783480 x1877052324077440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096709.515021:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790096709.515038:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324077440:0@lo:400: 00000100:00080000:1.0:1790096709.515082:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096709.515088:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096709.515091:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096709.518408:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790096709.518422:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324077312:12345-0@lo:400: 00000100:00100000:0.0:1790096709.518522:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324077312:12345-0@lo:400: Request processed in 104us (9749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096709.518529:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790096709.518582:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b42d80 x1877052324077312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096709.518598:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324077312:0@lo:400: 00000100:00100000:2.0:1790096709.523152:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096709.523168:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324077184:12345-0@lo:400: 00000100:00100000:2.0:1790096709.523271:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324077184:12345-0@lo:400: Request processed in 109us (19888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096709.523279:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790096709.524122:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096709.524132:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324077056:12345-0@lo:400: 00000100:00100000:3.0:1790096709.524179:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324077056:12345-0@lo:400: Request processed in 49us (20916us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096709.524185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1790096709.524947:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b43100 x1877052324077184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096709.524964:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324077184:0@lo:400: 00010000:00080000:1.0:1790096709.524980:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b40000 x1877052324077056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096709.524988:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324077056:0@lo:400: 00000100:00100000:3.0:1790096709.967747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096709.967788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096709.967985:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180800 00000100:00100000:1.0:1790096709.967994:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180800 00000100:00100000:1.0:1790096709.968068:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305180928 00000100:00100000:1.0:1790096709.968072:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305180928 00000100:00100000:1.0:1790096709.968098:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790096709.968107:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:0:x1877052305180800:12345-192.168.203.11@tcp:41: 00000004:00000024:1.0:1790096709.968150:0:7513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790096709.968220:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:0:x1877052305180800:12345-192.168.203.11@tcp:41: Request processed in 113us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.968227:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790096709.968243:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790096709.968249:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305180928:12345-192.168.203.11@tcp:41: 00000004:00000024:1.0:1790096709.968258:0:7513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790096709.968276:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305180928:12345-192.168.203.11@tcp:41: Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.968281:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00080000:3.0:1790096709.968460:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096709.973151:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096709.973302:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181056 00000100:00100000:1.0:1790096709.973312:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181056 00000100:00100000:1.0:1790096709.973371:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790096709.973381:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305181056:12345-192.168.203.11@tcp:40: 00000100:00100000:1.0:1790096709.973468:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305181056:12345-192.168.203.11@tcp:40: Request processed in 89us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.973475:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790096709.983730:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096709.983779:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096709.983807:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096709.983858:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096709.983897:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181184 00000100:00100000:0.0:1790096709.983907:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181184 00000100:00100000:0.0:1790096709.983939:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181312 00000100:00100000:0.0:1790096709.983942:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181312 00000100:00100000:0.0:1790096709.983960:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790096709.983967:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1877052305181184:12345-192.168.203.11@tcp:8: 00010000:00080000:0.0:1790096709.983996:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1790096709.984035:0:6696:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab588f 00002000:00100000:0.0:1790096709.984046:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7428525e-2b7d-490f-8a81-8b717b826fb3/ffff9eaaff5d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790096709.984070:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790096709.984394:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790096709.984425:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096709.984490:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305181184:12345-192.168.203.11@tcp:8: Request processed in 521us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096709.984497:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790096709.984518:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790096709.984522:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1877052305181312:12345-192.168.203.11@tcp:8: 00010000:00080000:0.0:1790096709.984537:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1790096709.984553:0:6696:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab5896 00002000:00100000:0.0:1790096709.984559:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7428525e-2b7d-490f-8a81-8b717b826fb3/ffff9eaaff325000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790096709.984572:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790096709.984814:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790096709.984828:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9eaaff326000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096709.984851:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305181312:12345-192.168.203.11@tcp:8: Request processed in 327us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096709.984857:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096709.985120:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181568 00000100:00100000:1.0:1790096709.985126:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181568 00000100:00100000:1.0:1790096709.985167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1790096709.985174:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305181568:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1790096709.985207:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305181568:12345-192.168.203.11@tcp:400: Request processed in 34us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096709.985222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:2.0:1790096709.985596:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181440 00000100:00100000:2.0:1790096709.985601:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181440 00000100:00100000:2.0:1790096709.985683:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790096709.985691:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305181440:12345-192.168.203.11@tcp:33: 00000100:00100000:0.0:1790096710.013080:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096710.013109:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324077568:0@lo:13: 00000100:00100000:0.0:1790096710.013178:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096710.013302:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077568 00000100:00100000:1.0:1790096710.013310:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077568 00000100:00100000:1.0:1790096710.013369:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790096710.013378:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324077568:12345-0@lo:13: 00002000:00000024:1.0:1790096710.013400:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096710.013449:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324077568:12345-0@lo:13: Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096710.013456:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790096710.013495:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185ad80 x1877052324077568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096710.013513:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324077568:0@lo:13: 00000004:00080000:0.0:1790096710.020825:0:5854:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35068us 00000004:00200000:1.0:1790096710.033708:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790096710.033830:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5587:x1877052305181440:12345-192.168.203.11@tcp:33: Request processed in 48135us (50113us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096710.033846:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00010000:00010000:2.0:1790096710.204917:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096710.231210:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096710.233449:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181696 00000100:00100000:3.0:1790096710.233465:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181696 00000100:00100000:3.0:1790096710.233550:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790096710.233560:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5628:x1877052305181696:12345-192.168.203.11@tcp:101: 00010000:00010000:3.0:1790096710.233581:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096710.234974:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab589d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e21 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235054:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235067:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235082:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096710.235118:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096710.235122:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096710.235140:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235181:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab589d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e21 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235202:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e21 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096710.235211:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:3.0:1790096710.235214:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096710.235232:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fc00, rc 0) 00000100:00100000:3.0:1790096710.235309:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:5628:x1877052305181696:12345-192.168.203.11@tcp:101: Request processed in 1749us (4114us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096710.235318:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00010000:00010000:0.0:1790096711.229106:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096712.252933:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096712.340998:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096712.341127:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181824 00000100:00100000:1.0:1790096712.341138:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181824 00000100:00100000:1.0:1790096712.341257:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096712.341269:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:5681:x1877052305181824:12345-192.168.203.11@tcp:41: 00000004:00000024:1.0:1790096712.341312:0:7513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790096712.341377:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:5681:x1877052305181824:12345-192.168.203.11@tcp:41: Request processed in 111us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096712.341385:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00080000:3.0:1790096712.341439:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096712.351487:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096712.351677:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305181952 00000100:00100000:3.0:1790096712.351702:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305181952 00000100:00100000:3.0:1790096712.351811:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790096712.351825:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5681:x1877052305181952:12345-192.168.203.11@tcp:13: 00000100:00080000:1.0:1790096712.351830:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790096712.351878:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096712.351971:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5681:x1877052305181952:12345-192.168.203.11@tcp:13: Request processed in 149us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096712.351979:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790096712.356798:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096712.358173:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182080 00000100:00100000:3.0:1790096712.358187:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182080 00000100:00100000:3.0:1790096712.358290:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790096712.358302:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5681:x1877052305182080:12345-192.168.203.11@tcp:13: 00002000:00000024:3.0:1790096712.358343:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790096712.358685:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096712.358962:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7428525e-2b7d-490f-8a81-8b717b826fb3+6:5681:x1877052305182080:12345-192.168.203.11@tcp:13: Request processed in 661us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096712.358970:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1790096712.572994:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096712.573022:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324077696:0@lo:13: 00000100:00100000:2.0:1790096712.573099:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096712.573230:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077696 00000100:00100000:3.0:1790096712.573239:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077696 00000100:00100000:3.0:1790096712.573314:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790096712.573324:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324077696:12345-0@lo:13: 00002000:00000024:3.0:1790096712.573346:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096712.573389:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324077696:12345-0@lo:13: Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096712.573410:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790096712.573581:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096712.573610:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff780380 x1877052324077696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096712.573630:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324077696:0@lo:13: 00010000:00010000:2.0:1790096713.276893:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790096714.189387:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000001:00100000:2.0:1790096714.195196:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00010000:00010000:2.0:1790096714.301770:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096714.624885:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324077824:0@lo:400: 00000100:00100000:0.0:1790096714.624963:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625011:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324078336:0@lo:400: 00000100:00100000:0.0:1790096714.625037:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625063:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790096714.625068:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324077952:0@lo:400: 00000100:00100000:0.0:1790096714.625087:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625104:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324078464:0@lo:400: 00000100:00100000:0.0:1790096714.625126:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625156:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078336 00000100:00100000:0.0:1790096714.625163:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078336 00000100:00100000:0.0:1790096714.625215:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077952 00000100:00100000:0.0:1790096714.625219:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077952 00000100:00100000:0.0:1790096714.625240:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790096714.625247:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324078336:12345-0@lo:400: 00000100:00100000:0.0:1790096714.625295:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324078336:12345-0@lo:400: Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096714.625302:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790096714.625318:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790096714.625323:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324077952:12345-0@lo:400: 00000100:00100000:0.0:1790096714.625347:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324077952:12345-0@lo:400: Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096714.625352:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790096714.625383:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078464 00000100:00100000:0.0:1790096714.625386:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078464 00000100:00100000:0.0:1790096714.625412:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096714.625418:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324078464:12345-0@lo:400: 00000100:00100000:0.0:1790096714.625448:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324078464:12345-0@lo:400: Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096714.625454:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096714.625496:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324077952:0@lo:400: 00010000:00080000:0.0:1790096714.625508:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaae8d6df80 x1877052324078464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096714.625518:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324078464:0@lo:400: 00000100:00100000:0.0:1790096714.625528:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324078336:0@lo:400: 00000100:00100000:0.0:1790096714.625565:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324078208:0@lo:400: 00000100:00100000:0.0:1790096714.625590:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625610:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096714.625616:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324078080:0@lo:400: 00000100:00100000:0.0:1790096714.625666:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096714.625702:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078080 00000100:00100000:0.0:1790096714.625706:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078080 00000100:00100000:0.0:1790096714.625727:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790096714.625732:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324078080:12345-0@lo:400: 00000100:00100000:0.0:1790096714.625761:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324078080:12345-0@lo:400: Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096714.625766:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790096714.625790:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324078080:0@lo:400: 00000100:00100000:0.0:1790096714.625822:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324077824 00000100:00100000:0.0:1790096714.625825:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324077824 00000100:00100000:0.0:1790096714.625849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790096714.625854:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324077824:12345-0@lo:400: 00000100:00100000:0.0:1790096714.625888:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324077824:12345-0@lo:400: Request processed in 34us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096714.625894:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790096714.625928:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324077824:0@lo:400: 00000100:00080000:0.0:1790096714.625974:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096714.625980:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096714.633134:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078208 00000100:00100000:3.0:1790096714.633148:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078208 00000100:00100000:3.0:1790096714.633219:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790096714.633230:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324078208:12345-0@lo:400: 00000100:00100000:3.0:1790096714.633324:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324078208:12345-0@lo:400: Request processed in 96us (7731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096714.633331:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790096714.633355:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790096714.633387:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaae8d6e300 x1877052324078208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096714.633403:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324078208:0@lo:400: 00000001:00100000:2.0:1790096714.731009:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000001:02000400:0.0:1790096715.097326:0:8319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1790096715.134220:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324078592:0@lo:13: 00000100:00100000:2.0:1790096715.134287:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096715.134407:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078592 00000100:00100000:3.0:1790096715.134415:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078592 00000100:00100000:3.0:1790096715.134466:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790096715.134475:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324078592:12345-0@lo:13: 00002000:00000024:3.0:1790096715.134510:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096715.139131:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324078592:12345-0@lo:13: Request processed in 4648us (4834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096715.139145:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790096715.139277:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaae8d6ca80 x1877052324078592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096715.139300:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324078592:0@lo:13: 00010000:00010000:3.0:1790096715.346044:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096715.432944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096715.432990:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096715.433032:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096715.433075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096715.433104:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182336 00000100:00100000:1.0:1790096715.433113:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182336 00000100:00100000:1.0:1790096715.433170:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790096715.433179:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305182336:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1790096715.433245:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305182336:12345-192.168.203.11@tcp:400: Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096715.433252:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790096715.433275:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182464 00000100:00100000:1.0:1790096715.433279:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182464 00000100:00100000:1.0:1790096715.433305:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182592 00000100:00100000:1.0:1790096715.433308:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182592 00000100:00100000:1.0:1790096715.433329:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096715.433336:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305182464:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1790096715.433363:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305182464:12345-192.168.203.11@tcp:400: Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096715.433369:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096715.433382:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790096715.433388:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305182592:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1790096715.433409:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305182592:12345-192.168.203.11@tcp:400: Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096715.433415:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:1.0:1790096715.433446:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096715.433450:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096715.433453:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096715.434179:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182208 00000100:00100000:0.0:1790096715.434186:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182208 00000100:00100000:0.0:1790096715.434229:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1790096715.434237:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305182208:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1790096715.434286:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305182208:12345-192.168.203.11@tcp:400: Request processed in 50us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096715.434293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00010000:00010000:0.0:1790096716.348860:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096717.376223:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096717.693982:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096717.694020:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324078720:0@lo:13: 00000100:00100000:2.0:1790096717.694110:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096717.694208:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324078720 00000100:00100000:2.0:1790096717.694218:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324078720 00000100:00100000:2.0:1790096717.694288:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096717.694297:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324078720:12345-0@lo:13: 00002000:00000024:2.0:1790096717.694341:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096717.694388:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324078720:12345-0@lo:13: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096717.694396:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790096717.694418:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096717.694451:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9aa00 x1877052324078720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096717.694472:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324078720:0@lo:13: 00010000:00010000:1.0:1790096718.400015:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790096719.179747:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6eb5c0e0 20000000:00000080:3.0:1790096719.179835:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaafb684c00 uarg=0000000000000000 20000000:01000000:3.0:1790096719.179886:0:8467:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790096719.179889:0:8467:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790096719.179893:0:8467:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790096719.179907:0:8467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790096719.179914:0:8467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790096719.179936:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790096719.179939:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790096719.180415:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790096719.180420:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790096719.188179:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1790096719.189041:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1790096719.189117:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1790096719.189155:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1790096719.189170:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790096719.189173:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790096719.189998:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1790096719.191066:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1790096719.191625:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1790096719.192409:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1790096719.192435:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790096719.192438:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790096719.194728:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790096719.196169:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790096719.196235:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790096719.196273:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790096719.196291:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790096719.196294:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790096719.198907:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790096719.200725:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790096719.200836:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790096719.200880:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1790096719.200907:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790096719.200935:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.200959:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.200967:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.200989:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.200997:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201004:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201011:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201018:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201028:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201035:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201042:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201095:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201128:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 9 pid: 5845 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201157:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324078848:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096719.201296:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201305:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 9 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201313:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324078976:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096719.201341:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201348:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 18 pid: 5845 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201357:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079104:0@lo:104: 00000100:00100000:2.0:1790096719.201401:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790096719.201438:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201445:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 18 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201453:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079232:0@lo:104: 00000100:00100000:2.0:1790096719.201472:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790096719.201491:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201499:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201514:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079360:0@lo:104: 00010000:00010000:2.0:1790096719.201535:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201543:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201550:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079488:0@lo:104: 00010000:00010000:2.0:1790096719.201574:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201581:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 18 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201589:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079616:0@lo:104: 00010000:00010000:2.0:1790096719.201610:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201618:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 18 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201626:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079744:0@lo:104: 00010000:00010000:2.0:1790096719.201687:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.201695:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.201727:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079872:0@lo:104: 00000100:00100000:2.0:1790096719.201749:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae69daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790096719.202442:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790096719.202469:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.202485:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.202493:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.202501:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.202525:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.202535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079104 00000100:00100000:0.0:1790096719.202547:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079104 00000100:00100000:0.0:1790096719.202594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079232 00000100:00100000:0.0:1790096719.202597:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079232 00000100:00100000:0.0:1790096719.202606:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079360 00000100:00100000:0.0:1790096719.202608:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079360 00000100:00100000:0.0:1790096719.202615:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079488 00000100:00100000:0.0:1790096719.202617:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079488 00000100:00100000:0.0:1790096719.202626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079616 00000100:00100000:0.0:1790096719.202628:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079616 00000100:00100000:0.0:1790096719.202668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079744 00000100:00100000:0.0:1790096719.202671:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079744 00000100:00100000:0.0:1790096719.202681:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324079872 00000100:00100000:0.0:1790096719.202684:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324079872 00000100:00100000:0.0:1790096719.202698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790096719.202707:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:8467:x1877052324079104:12345-0@lo:104: 00010000:00010000:0.0:1790096719.202725:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.202803:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096719.202809:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+9:8467:x1877052324079104:12345-0@lo:104: Request processed in 103us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.202826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1790096719.202841:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790096719.202845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1790096719.202850:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.202851:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+8:8467:x1877052324079232:12345-0@lo:104: 00010000:00010000:1.0:1790096719.202858:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1a67c20) 00010000:00010000:0.0:1790096719.202860:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096719.202864:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.202874:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096719.202882:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096719.202889:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096719.202895:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096719.202900:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+8:8467:x1877052324079232:12345-0@lo:104: Request processed in 50us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.202905:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1790096719.202926:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.202932:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096719.202951:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.202954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1790096719.202959:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab5857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab585e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.202960:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:8467:x1877052324079360:12345-0@lo:104: 00010000:00010000:0.0:1790096719.202968:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.202974:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096719.202983:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.202989:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a600 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096719.202992:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.202999:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.202999:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096719.203004:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+7:8467:x1877052324079360:12345-0@lo:104: Request processed in 45us (535us total) trans 0 rc 0/0 10000000:00010000:1.0:1790096719.203006:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.203010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:1.0:1790096719.203012:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790096719.203020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096719.203025:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:8467:x1877052324079488:12345-0@lo:104: 00010000:00010000:1.0:1790096719.203026:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203032:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096719.203032:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203037:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203043:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a600/0xcc97d9eae5ab582d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5834 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203051:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096719.203054:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203059:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1790096719.203060:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1486200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096719.203064:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.203064:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+6:8467:x1877052324079488:12345-0@lo:104: Request processed in 38us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.203070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096719.203080:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1790096719.203081:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.203085:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:8467:x1877052324079616:12345-0@lo:104: 10000000:00010000:1.0:1790096719.203088:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096719.203094:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790096719.203107:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203113:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096719.203130:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203138:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1486200/0xcc97d9eae5ab5811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5818 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203147:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096719.203151:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203156:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0031200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096719.203159:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203165:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096719.203170:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096719.203182:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790096719.203196:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203202:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096719.203208:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203214:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0031200/0xcc97d9eae5ab5803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab580a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203225:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096719.203226:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096719.203228:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096719.203246:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096719.203259:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324080256:0@lo:103: 00000100:00100000:1.0:1790096719.203298:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096719.203329:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096719.203335:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324080384:0@lo:103: 00010000:00010000:0.0:1790096719.203344:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.203354:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096719.203390:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080256 00000100:00100000:1.0:1790096719.203396:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080256 00000100:00100000:3.0:1790096719.203407:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080384 00000100:00100000:3.0:1790096719.203411:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080384 00010000:00010000:1.0:1790096719.203419:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 20 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.203426:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 20 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.203442:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790096719.203448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3316:x1877052324080256:12345-0@lo:103: 00010000:00010000:1.0:1790096719.203459:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096719.203470:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 20 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203480:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 20 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.203502:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096719.203529:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079104:0@lo:104: 00000100:00100000:1.0:1790096719.203530:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3316:x1877052324080256:12345-0@lo:103: Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096719.203539:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079232:0@lo:104: 00010000:00010000:0.0:1790096719.203555:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096719.203561:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:8467:x1877052324079616:12345-0@lo:104: Request processed in 477us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.203568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790096719.203587:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790096719.203593:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8467:x1877052324079744:12345-0@lo:104: 00010000:00010000:0.0:1790096719.203601:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203661:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790096719.203666:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8467:x1877052324079744:12345-0@lo:104: Request processed in 74us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.203673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790096719.203684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790096719.203690:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:8467:x1877052324079872:12345-0@lo:104: 00010000:00010000:0.0:1790096719.203698:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203720:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790096719.203725:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:8467:x1877052324079872:12345-0@lo:104: Request processed in 35us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.203730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790096719.203743:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790096719.203747:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203754:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0031800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096719.203758:0:7651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203765:0:7651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096719.203782:0:7651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096719.203788:0:7651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096719.203804:0:7651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203809:0:7651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096719.203814:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203821:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0031800/0xcc97d9eae5ab57f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203830:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096719.203833:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203839:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1487e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096719.203842:0:7651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203849:0:7651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096719.203854:0:7651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096719.203859:0:7651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096719.203873:0:7651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203879:0:7651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096719.203883:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203889:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1487e00/0xcc97d9eae5ab57cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57d2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203897:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096719.203899:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203904:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096719.203907:0:7651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203914:0:7651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096719.203920:0:7651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096719.203926:0:7651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096719.203933:0:7651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203938:0:7651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096719.203942:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203956:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab57a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57a8 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.203969:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096719.203971:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096719.203972:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096719.203983:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080000:0@lo:103: 00000100:00100000:0.0:1790096719.204008:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.204030:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080512:0@lo:103: 00000100:00100000:0.0:1790096719.204044:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.204054:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790096719.204058:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080128:0@lo:103: 00000100:00100000:0.0:1790096719.204073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096719.204080:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080640:0@lo:103: 00000100:00100000:0.0:1790096719.204115:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790096719.204136:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096719.204142:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096719.204148:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324080768:0@lo:103: 00000100:00100000:0.0:1790096719.204168:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790096719.204180:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096719.204184:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096719.204245:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab5818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5811 expref: 20 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096719.204257:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079360:0@lo:104: 00000100:00100000:2.0:1790096719.204265:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079488:0@lo:104: 00000100:00100000:2.0:1790096719.204272:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079616:0@lo:104: 00000100:00100000:2.0:1790096719.204279:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079744:0@lo:104: 00000100:00100000:2.0:1790096719.204285:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324079872:0@lo:104: 00000100:00100000:0.0:1790096719.204747:0:5838:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790096719.204759:0:5838:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790096719.204790:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324080256:0@lo:103: 00000100:00100000:2.0:1790096719.208068:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080000 00000100:00100000:2.0:1790096719.208099:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080000 00010000:00010000:2.0:1790096719.208162:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 20 pid: 5845 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.208380:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080512 00000100:00100000:0.0:1790096719.208386:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080512 00010000:00010000:0.0:1790096719.208410:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 21 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096719.208623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790096719.208659:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+21:3316:x1877052324080384:12345-0@lo:103: 00010000:00010000:3.0:1790096719.208679:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096719.208687:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 21 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.208712:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 21 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.208735:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1487400/0xcc97d9eae5ab580a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5803 expref: 21 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.208755:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096719.208862:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3316:x1877052324080384:12345-0@lo:103: Request processed in 229us (5505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096719.208870:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790096719.208894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080128 00000100:00100000:3.0:1790096719.208898:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080128 00010000:00010000:3.0:1790096719.208911:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 20 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096719.208924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080640 00000100:00100000:3.0:1790096719.208927:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080640 00010000:00010000:3.0:1790096719.208936:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 21 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096719.208945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080768 00000100:00100000:3.0:1790096719.208949:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080768 00010000:00010000:3.0:1790096719.208959:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 22 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096719.208971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790096719.208977:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+22:3314:x1877052324080128:12345-0@lo:103: 00010000:00010000:3.0:1790096719.208986:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096719.208990:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 22 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209005:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 22 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209015:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac0031c00/0xcc97d9eae5ab5834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab582d expref: 22 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209025:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096719.209056:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+21:3314:x1877052324080128:12345-0@lo:103: Request processed in 79us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096719.209062:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790096719.209075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790096719.209080:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3314:x1877052324080640:12345-0@lo:103: 00010000:00010000:3.0:1790096719.209098:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096719.209572:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 20 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209587:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 20 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209599:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab57d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab57cb expref: 20 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209611:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096719.209682:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324080640:12345-0@lo:103: Request processed in 601us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096719.209690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790096719.209710:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790096719.209717:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3317:x1877052324080768:12345-0@lo:103: 00010000:00010000:3.0:1790096719.209736:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096719.209740:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209748:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209759:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab57a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab57a1 expref: 18 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096719.209768:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096719.209804:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:3317:x1877052324080768:12345-0@lo:103: Request processed in 88us (5635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096719.209822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790096719.209881:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324080384:0@lo:103: 00000100:00100000:3.0:1790096719.209921:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080128:0@lo:103: 00000100:00100000:3.0:1790096719.209930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080640:0@lo:103: 00000100:00100000:3.0:1790096719.209956:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324080768:0@lo:103: 00000100:00100000:1.0:1790096719.211831:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096719.215360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790096719.215392:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3314:x1877052324080000:12345-0@lo:103: 00010000:00010000:2.0:1790096719.215448:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096719.215460:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 15 pid: 5845 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.215476:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 15 pid: 5845 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.215508:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab585e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5857 expref: 15 pid: 5845 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096719.215527:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096719.215626:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3314:x1877052324080000:12345-0@lo:103: Request processed in 252us (11616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096719.215662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790096719.215843:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790096719.215855:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:3314:x1877052324080512:12345-0@lo:103: 00000100:00100000:1.0:1790096719.215864:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1790096719.215864:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096719.215869:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 13 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.215879:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 13 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.215889:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1790096719.215890:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f200/0xcc97d9eae5ab57fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab57f5 expref: 13 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.215901:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096719.215912:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182848 00000100:00100000:1.0:1790096719.215921:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182848 00000100:00100000:0.0:1790096719.215931:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3314:x1877052324080512:12345-0@lo:103: Request processed in 81us (11886us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.215936:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790096719.215948:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 10 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.215961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182720 00000100:00100000:1.0:1790096719.215964:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182720 00010000:00010000:1.0:1790096719.215973:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 11 pid: 5845 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.215983:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790096719.216821:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080000:0@lo:103: 00000100:00100000:2.0:1790096719.216836:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324080512:0@lo:103: 00000100:00100000:0.0:1790096719.216999:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790096719.217007:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2363:x1877052305182848:12345-192.168.203.11@tcp:103: 00000100:00100000:0.0:1790096719.217015:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2363:x1877052305182720:12345-192.168.203.11@tcp:103: 00010000:00010000:1.0:1790096719.217026:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096719.217027:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096719.217040:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 11 pid: 5845 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217041:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 11 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.217070:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 11 pid: 5845 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217086:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 11 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096719.217328:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096719.217376:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217388:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217408:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217417:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217425:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217433:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096719.217435:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2363:x1877052305182720:12345-192.168.203.11@tcp:103: Request processed in 426us (1543us total) trans 0 rc 0/0 00010000:00010000:1.0:1790096719.217449:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539e00 already unused, calling callback (ffffffffc141c900) 00000100:00100000:0.0:1790096719.217453:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00010000:00010000:1.0:1790096719.217457:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217532:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217543:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.217556:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096719.217582:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2363:x1877052305182848:12345-192.168.203.11@tcp:103: Request processed in 586us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096719.217599:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:1.0:1790096719.218209:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab5873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dc6 expref: 9 pid: 5845 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.218227:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324078848:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096719.218244:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab586c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820dbf expref: 8 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096719.218254:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877052324078976:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096719.218419:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.218431:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.218438:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.218444:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539e00/0xcc97d9eae5ab58ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096719.422047:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096719.742503:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324080896:0@lo:400: 00000100:00100000:3.0:1790096719.742609:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096719.742623:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324081024:0@lo:400: 00000100:00100000:3.0:1790096719.742721:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324081408:0@lo:400: 00000100:00100000:2.0:1790096719.742725:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096719.742760:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324081536:0@lo:400: 00000100:00100000:3.0:1790096719.742767:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096719.742797:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096719.742801:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790096719.742810:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324081280:0@lo:400: 00000100:00100000:2.0:1790096719.742825:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096719.742835:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324081152:0@lo:400: 00000100:00100000:3.0:1790096719.742842:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096719.742868:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096719.742897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081024 00000100:00100000:3.0:1790096719.742907:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081024 00000100:00100000:3.0:1790096719.742964:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081408 00000100:00100000:3.0:1790096719.742968:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081408 00000100:00100000:2.0:1790096719.742974:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081152 00000100:00100000:2.0:1790096719.742981:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081152 00000100:00100000:3.0:1790096719.743008:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096719.743085:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324081024:12345-0@lo:400: 00000100:00100000:3.0:1790096719.743141:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324081024:12345-0@lo:400: Request processed in 59us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096719.744040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324080896 00000100:00100000:1.0:1790096719.744051:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324080896 00000100:00100000:1.0:1790096719.744105:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790096719.744114:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3317:x1877052324080896:12345-0@lo:400: 00000100:00100000:1.0:1790096719.744182:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:3317:x1877052324080896:12345-0@lo:400: Request processed in 69us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096719.744206:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790096719.744250:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081536 00000100:00100000:1.0:1790096719.744254:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081536 00000100:00100000:1.0:1790096719.744300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081280 00000100:00100000:1.0:1790096719.744304:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081280 00000100:00100000:1.0:1790096719.744327:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790096719.744334:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324081536:12345-0@lo:400: 00000100:00100000:1.0:1790096719.744368:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324081536:12345-0@lo:400: Request processed in 35us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096719.744374:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790096719.744385:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790096719.744391:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324081280:12345-0@lo:400: 00000100:00100000:1.0:1790096719.744417:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324081280:12345-0@lo:400: Request processed in 27us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096719.744424:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790096719.746052:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790096719.746064:0:5853:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790096719.746077:0:5853:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1790096719.746086:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324081408:12345-0@lo:400: 00000100:00080000:2.0:1790096719.746111:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096719.746117:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096719.746121:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096719.746192:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324081408:12345-0@lo:400: Request processed in 126us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.746206:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790096719.746232:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790096719.746239:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324081152:12345-0@lo:400: 00000100:00100000:0.0:1790096719.746272:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324081152:12345-0@lo:400: Request processed in 35us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096719.746279:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790096719.746453:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096719.746614:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324081152:0@lo:400: 00000100:00100000:3.0:1790096719.746660:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324081024:0@lo:400: 00010000:00080000:3.0:1790096719.746681:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6d500 x1877052324081536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096719.746693:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324081536:0@lo:400: 00010000:00080000:3.0:1790096719.747190:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b41500 x1877052324081280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096719.747202:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324081280:0@lo:400: 00000100:00100000:3.0:1790096719.747217:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324080896:0@lo:400: 00000100:00100000:3.0:1790096719.747233:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324081408:0@lo:400: 00000100:00100000:2.0:1790096720.256559:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324081664:0@lo:13: 00000100:00100000:2.0:1790096720.256698:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096720.257038:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081664 00000100:00100000:0.0:1790096720.257049:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081664 00000100:00100000:0.0:1790096720.257114:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096720.257124:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324081664:12345-0@lo:13: 00002000:00000024:0.0:1790096720.257169:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096720.257230:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324081664:12345-0@lo:13: Request processed in 107us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096720.257238:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790096720.257345:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e9f80 x1877052324081664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096720.257383:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324081664:0@lo:13: 00010000:00010000:0.0:1790096720.446112:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096720.553731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.553784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.553824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.553867:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096720.554018:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305182976 00000100:00100000:0.0:1790096720.554031:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305182976 00000100:00100000:0.0:1790096720.554585:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1790096720.554596:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:2362:x1877052305182976:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1790096720.554723:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:2362:x1877052305182976:12345-192.168.203.11@tcp:400: Request processed in 127us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096720.554747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:3.0:1790096720.555064:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183104 00000100:00100000:3.0:1790096720.555073:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183104 00000100:00100000:3.0:1790096720.555225:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1790096720.555235:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305183104:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1790096720.555279:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305183104:12345-192.168.203.11@tcp:400: Request processed in 47us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096720.555295:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00080000:3.0:1790096720.555344:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096720.556390:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183232 00000100:00100000:2.0:1790096720.556401:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183232 00000100:00100000:2.0:1790096720.556529:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183360 00000100:00100000:2.0:1790096720.556533:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183360 00000100:00100000:2.0:1790096720.556578:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790096720.556588:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305183232:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790096720.556672:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305183232:12345-192.168.203.11@tcp:400: Request processed in 84us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096720.556679:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790096720.556697:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096720.556703:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305183360:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790096720.556725:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305183360:12345-192.168.203.11@tcp:400: Request processed in 23us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096720.556731:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:3.0:1790096720.556940:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096720.556945:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096720.617390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096720.617579:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183488 00000100:00100000:0.0:1790096720.617593:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183488 00000100:00100000:0.0:1790096720.617704:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1790096720.617716:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:5601:x1877052305183488:12345-192.168.203.11@tcp:101: 00010000:00010000:0.0:1790096720.617739:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096720.617767:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690000/0xcc97d9eae5ab58b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e28 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096720.617807:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690000/0xcc97d9eae5ab58b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e28 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096720.617822:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690000/0xcc97d9eae5ab58b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e28 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096720.617833:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690000, rc 0) 00000100:00100000:0.0:1790096720.617922:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305183488:12345-192.168.203.11@tcp:101: Request processed in 208us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096720.617930:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:3.0:1790096720.620924:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096720.622347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183616 00000100:00100000:0.0:1790096720.622366:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183616 00000100:00100000:0.0:1790096720.622451:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1790096720.622463:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305183616:12345-192.168.203.11@tcp:501: 00000100:00100000:0.0:1790096720.623531:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305183616:12345-192.168.203.11@tcp:501: Request processed in 1064us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096720.623542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:2.0:1790096720.631212:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.632255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183744 00000100:00100000:1.0:1790096720.632272:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183744 00000100:00100000:1.0:1790096720.632402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1790096720.632423:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305183744:12345-192.168.203.11@tcp:503: 00000100:00100000:1.0:1790096720.632795:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305183744:12345-192.168.203.11@tcp:503: Request processed in 374us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096720.632816:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1790096720.640271:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096720.640903:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305183872 00000100:00100000:0.0:1790096720.640937:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305183872 00000100:00100000:0.0:1790096720.641014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1790096720.641027:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:6075:x1877052305183872:12345-192.168.203.11@tcp:502: 00000100:00100000:0.0:1790096720.641560:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:6075:x1877052305183872:12345-192.168.203.11@tcp:502: Request processed in 414us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096720.641574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:3.0:1790096720.649117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.657232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184000 00000100:00100000:1.0:1790096720.657258:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184000 00000100:00100000:1.0:1790096720.657404:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1790096720.657416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:6075:x1877052305184000:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790096720.657982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:6075:x1877052305184000:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 565us (8877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096720.657992:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1790096720.662710:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096720.662893:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184128 00000100:00100000:2.0:1790096720.662908:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184128 00000100:00100000:2.0:1790096720.663217:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1790096720.663231:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305184128:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096720.663258:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096720.663284:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab58b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e2f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096720.663331:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab58b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e2f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096720.663368:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab58b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e2f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096720.663380:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1539a00, rc 0) 00000100:00100000:2.0:1790096720.663579:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184128:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 350us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096720.663588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:0.0:1790096720.669278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096720.669542:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184256 00000100:00100000:1.0:1790096720.669556:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184256 00000100:00100000:0.0:1790096720.669940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1790096720.669955:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184256:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096720.670355:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184256:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 400us (1088us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096720.670365:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 10000000:01000000:2.0:1790096721.213216:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790096721.213228:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaaff322800 from 39 10000000:01000000:2.0:1790096721.213236:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790096721.213310:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.213324:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.213338:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096721.214494:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324081792:0@lo:101: 00000100:00100000:2.0:1790096721.214866:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.215085:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3840 going to sleep for 11 seconds 00000100:00100000:0.0:1790096721.215400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081792 00000100:00100000:0.0:1790096721.215413:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081792 00000100:00100000:0.0:1790096721.215491:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790096721.215513:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+12:5849:x1877052324081792:12345-0@lo:101: 00010000:00010000:0.0:1790096721.215535:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096721.215558:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8691c00/0xcc97d9eae5ab58c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab58c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096721.215595:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8691c00/0xcc97d9eae5ab58c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58c0 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096721.215608:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8691c00/0xcc97d9eae5ab58c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58c0 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096721.215618:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691c00, rc 0) 00000100:00100000:0.0:1790096721.215744:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324081792:12345-0@lo:101: Request processed in 243us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096721.215752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790096721.216087:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324081792:0@lo:101: 00010000:00010000:2.0:1790096721.216110:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.216122:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096721.216224:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324081920:0@lo:501: 00000100:00100000:2.0:1790096721.216263:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096721.216343:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324081920 00000100:00100000:0.0:1790096721.216359:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324081920 00000100:00100000:0.0:1790096721.216399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790096721.216407:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324081920:12345-0@lo:501: 00000100:00100000:0.0:1790096721.216796:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324081920:12345-0@lo:501: Request processed in 386us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096721.216805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790096721.220057:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3840 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.220128:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324081920:0@lo:501: 00000100:00100000:2.0:1790096721.220227:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082048:0@lo:503: 00000100:00100000:2.0:1790096721.220533:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.220702:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.220851:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082048 00000100:00100000:1.0:1790096721.221019:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082048 00000100:00100000:1.0:1790096721.221082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790096721.221092:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324082048:12345-0@lo:503: 00000100:00100000:1.0:1790096721.221584:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324082048:12345-0@lo:503: Request processed in 490us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.221595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790096721.221611:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082048:0@lo:503: 00000100:00100000:1.0:1790096721.224514:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8485:1877052324082176:0@lo:502: 00000100:00100000:1.0:1790096721.224695:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.224760:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028180 going to sleep for 11 seconds 00000100:00100000:0.0:1790096721.225005:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082176 00000100:00100000:0.0:1790096721.225017:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082176 00000100:00100000:0.0:1790096721.225081:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790096721.225092:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:8485:x1877052324082176:12345-0@lo:502: 00000100:00100000:0.0:1790096721.225433:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:8485:x1877052324082176:12345-0@lo:502: Request processed in 343us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096721.225442:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790096721.225772:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8485:1877052324082176:0@lo:502: 00000100:00100000:1.0:1790096721.225839:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8485:1877052324082304:0@lo:502: 00000100:00100000:1.0:1790096721.225880:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.225925:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.226371:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082304 00000100:00100000:2.0:1790096721.226380:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082304 00000100:00100000:2.0:1790096721.226430:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790096721.226439:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:8485:x1877052324082304:12345-0@lo:502: 00000100:00100000:2.0:1790096721.226733:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:8485:x1877052324082304:12345-0@lo:502: Request processed in 294us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.226742:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790096721.226847:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8485:1877052324082304:0@lo:502: 00000040:00080000:3.0:1790096721.226880:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790096721.227246:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790096721.227268:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790096721.227280:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.227295:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096721.227308:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790096721.227312:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790096721.227324:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790096721.227373:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.227384:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.227394:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096721.227412:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082432:0@lo:101: 00000100:00100000:2.0:1790096721.227454:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.227504:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.227898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082432 00000100:00100000:1.0:1790096721.227907:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082432 00000100:00100000:1.0:1790096721.227964:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790096721.227973:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+13:5849:x1877052324082432:12345-0@lo:101: 00010000:00010000:1.0:1790096721.227987:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096721.228004:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17a600/0xcc97d9eae5ab58d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab58ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.228036:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17a600/0xcc97d9eae5ab58d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ce expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.228049:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17a600/0xcc97d9eae5ab58d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ce expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.228059:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a600, rc 0) 00000100:00100000:1.0:1790096721.228107:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324082432:12345-0@lo:101: Request processed in 134us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.228114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790096721.228161:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082432:0@lo:101: 00010000:00010000:1.0:1790096721.228176:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.228186:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.228246:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082560:0@lo:501: 00000100:00100000:1.0:1790096721.228275:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.228297:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.228320:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082560 00000100:00100000:1.0:1790096721.228324:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082560 00000100:00100000:1.0:1790096721.228341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790096721.228452:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324082560:12345-0@lo:501: 00000100:00100000:1.0:1790096721.229133:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324082560:12345-0@lo:501: Request processed in 782us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.229141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790096721.229828:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082560:0@lo:501: 00000100:00100000:3.0:1790096721.229886:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082688:0@lo:503: 00000100:00100000:3.0:1790096721.229947:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096721.230029:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.233718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082688 00000100:00100000:2.0:1790096721.233745:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082688 00000100:00100000:2.0:1790096721.233838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790096721.233849:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324082688:12345-0@lo:503: 00000100:00100000:2.0:1790096721.234226:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324082688:12345-0@lo:503: Request processed in 377us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.234235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790096721.234507:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324082688:0@lo:503: 00000100:00100000:3.0:1790096721.250073:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8486:1877052324082816:0@lo:502: 00000100:00100000:3.0:1790096721.250209:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096721.250273:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.250620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082816 00000100:00100000:1.0:1790096721.250666:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082816 00000100:00100000:1.0:1790096721.250743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790096721.250754:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8486:x1877052324082816:12345-0@lo:502: 00000100:00100000:1.0:1790096721.251091:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8486:x1877052324082816:12345-0@lo:502: Request processed in 338us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.251100:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790096721.251470:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8486:1877052324082816:0@lo:502: 00000020:01000000:3.0:1790096721.251528:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096721.251540:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096721.251542:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790096721.251548:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790096721.251583:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8486:1877052324082944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096721.251660:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096721.251758:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096721.262282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324082944 00000100:00100000:0.0:1790096721.262305:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324082944 00000100:00100000:0.0:1790096721.262403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790096721.262416:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8486:x1877052324082944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096721.263118:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:8486:x1877052324082944:12345-0@lo:502:llog_process_th.0 Request processed in 700us (11483us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096721.263130:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790096721.265185:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8486:1877052324082944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790096721.265449:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096721.265461:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096721.265464:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790096721.265470:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1790096721.265874:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1790096721.265901:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790096721.265915:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.265928:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096721.265940:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790096721.265943:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac4279800 from 39 10000000:01000000:1.0:1790096721.265947:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790096721.265993:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.266003:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.266021:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.266049:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.266131:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.266235:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae60286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.266290:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083072 00000100:00100000:2.0:1790096721.266301:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083072 00000100:00100000:2.0:1790096721.266516:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790096721.266530:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:5849:x1877052324083072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096721.266549:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096721.266565:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab58e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab58dc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.266594:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab58e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58dc expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.266615:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab58e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58dc expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.266673:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1538000, rc 0) 00000100:00100000:2.0:1790096721.266724:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.266731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790096721.266825:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.266843:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.266852:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.266929:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.266974:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.268097:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae60286c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096721.268194:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083200 00000100:00100000:0.0:1790096721.268206:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083200 00000100:00100000:0.0:1790096721.268257:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790096721.268266:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096721.269020:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 751us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096721.269031:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790096721.269160:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.269223:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.269281:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.269431:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae60286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.270898:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083328 00000100:00100000:2.0:1790096721.270917:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083328 00000100:00100000:2.0:1790096721.270984:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790096721.270995:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.271322:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.271331:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790096721.271799:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.272410:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8487:1877052324083456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.272493:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.272780:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.272852:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083456 00000100:00100000:1.0:1790096721.272862:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083456 00000100:00100000:1.0:1790096721.272903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790096721.272912:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8487:x1877052324083456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.273220:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8487:x1877052324083456:12345-0@lo:502:llog_process_th.0 Request processed in 307us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.273227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790096721.273466:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8487:1877052324083456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.273548:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8487:1877052324083584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.273591:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.273656:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.273783:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083584 00000100:00100000:1.0:1790096721.273789:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083584 00000100:00100000:1.0:1790096721.273817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790096721.273824:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8487:x1877052324083584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.274009:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:8487:x1877052324083584:12345-0@lo:502:llog_process_th.0 Request processed in 183us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.274017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790096721.277830:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8487:1877052324083584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790096721.277913:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790096721.278198:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790096721.278229:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790096721.278241:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.278255:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096721.278268:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790096721.278271:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1790096721.278274:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790096721.278325:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.278333:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.278345:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.278399:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.278487:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.278697:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028180 going to sleep for 11 seconds 00000100:00100000:3.0:1790096721.278900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083712 00000100:00100000:3.0:1790096721.278910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083712 00000100:00100000:3.0:1790096721.278989:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790096721.279000:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:5849:x1877052324083712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096721.279018:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096721.279034:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab58f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab58ea expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096721.279064:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab58f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ea expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096721.279076:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab58f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ea expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096721.279085:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e400, rc 0) 00000100:00100000:3.0:1790096721.279133:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324083712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096721.279139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790096721.279242:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.279258:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.279268:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.279586:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.279625:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.279695:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.279785:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083840 00000100:00100000:2.0:1790096721.279806:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083840 00000100:00100000:2.0:1790096721.279836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790096721.279844:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324083840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.280169:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324083840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.280178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790096721.280526:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.280571:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.280620:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.280684:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.280852:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324083968 00000100:00100000:2.0:1790096721.280859:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324083968 00000100:00100000:2.0:1790096721.280884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790096721.280890:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324083968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.281068:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324083968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.281075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790096721.282713:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324083968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.285255:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8488:1877052324084096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.285453:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.285694:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.285859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084096 00000100:00100000:1.0:1790096721.285870:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084096 00000100:00100000:1.0:1790096721.285974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790096721.285987:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8488:x1877052324084096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.286374:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8488:x1877052324084096:12345-0@lo:502:llog_process_th.0 Request processed in 388us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.286395:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790096721.286964:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8488:1877052324084096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790096721.287025:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096721.287038:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096721.287041:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790096721.287048:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790096721.287098:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8488:1877052324084224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.287168:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.287256:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.287357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084224 00000100:00100000:1.0:1790096721.287366:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084224 00000100:00100000:1.0:1790096721.287457:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790096721.287468:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8488:x1877052324084224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.287822:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:8488:x1877052324084224:12345-0@lo:502:llog_process_th.0 Request processed in 355us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.287830:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790096721.287939:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8488:1877052324084224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790096721.287968:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096721.287981:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096721.287983:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790096721.287988:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790096721.293225:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790096721.293269:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790096721.293285:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.293301:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096721.293314:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790096721.293317:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac41f3800 from 39 10000000:01000000:1.0:1790096721.293320:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790096721.293580:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.293590:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.293605:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.293699:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.293817:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.293875:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.293980:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084352 00000100:00100000:2.0:1790096721.293992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084352 00000100:00100000:2.0:1790096721.294050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790096721.294061:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324084352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096721.294079:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096721.294095:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1539800/0xcc97d9eae5ab58ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab58f8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.294125:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1539800/0xcc97d9eae5ab58ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58f8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.294138:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1539800/0xcc97d9eae5ab58ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab58f8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.294149:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1539800, rc 0) 00000100:00100000:2.0:1790096721.294197:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.294204:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790096721.294442:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.294462:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.294473:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.294994:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.295040:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.295113:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.295130:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084480 00000100:00100000:1.0:1790096721.295136:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084480 00000100:00100000:1.0:1790096721.295165:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790096721.295173:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.295726:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.295736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790096721.296729:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096721.296802:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096721.296881:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096721.296994:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.297072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084608 00000100:00100000:1.0:1790096721.297082:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084608 00000100:00100000:1.0:1790096721.297168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790096721.297179:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.297830:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 649us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.297841:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790096721.298171:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096721.306521:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8489:1877052324084736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096721.306700:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096721.306752:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14600 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.307106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084736 00000100:00100000:1.0:1790096721.307118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084736 00000100:00100000:1.0:1790096721.307184:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790096721.307197:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8489:x1877052324084736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.307789:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8489:x1877052324084736:12345-0@lo:502:llog_process_th.0 Request processed in 590us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.307799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790096721.307981:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8489:1877052324084736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096721.308071:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8489:1877052324084864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096721.308118:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096721.308158:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14600 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.309391:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084864 00000100:00100000:1.0:1790096721.309404:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084864 00000100:00100000:1.0:1790096721.309476:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790096721.309487:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8489:x1877052324084864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.310077:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8489:x1877052324084864:12345-0@lo:502:llog_process_th.0 Request processed in 589us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.310088:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790096721.310234:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8489:1877052324084864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790096721.310279:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790096721.310486:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790096721.310527:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790096721.310540:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.310555:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096721.310568:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790096721.310580:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790096721.310584:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790096721.310623:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.310676:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.310686:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096721.310709:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.310760:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096721.310794:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.312013:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324084992 00000100:00100000:1.0:1790096721.312029:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324084992 00000100:00100000:1.0:1790096721.312099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790096721.312110:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324084992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.312129:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096721.312148:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17ba00/0xcc97d9eae5ab590d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5906 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.312179:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17ba00/0xcc97d9eae5ab590d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5906 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.312191:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17ba00/0xcc97d9eae5ab590d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5906 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.315771:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17ba00, rc 0) 00000100:00100000:1.0:1790096721.315895:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324084992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3782us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.315905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790096721.316014:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324084992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.316045:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.316058:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.316157:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.316192:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.316225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085120 00000100:00100000:1.0:1790096721.316231:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085120 00000100:00100000:1.0:1790096721.316266:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790096721.316275:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324085120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.316586:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324085120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.316593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790096721.316675:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb938900 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.316689:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.316720:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.316765:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.316793:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085248 00000100:00100000:1.0:1790096721.316797:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085248 00000100:00100000:1.0:1790096721.316817:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790096721.316823:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324085248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.316981:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324085248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.316988:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790096721.317018:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb938900 going to sleep for 11 seconds 00000100:00100000:1.0:1790096721.317031:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.317295:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8490:1877052324085376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.317329:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.317347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085376 00000100:00100000:1.0:1790096721.317352:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085376 00000100:00100000:1.0:1790096721.317373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790096721.317379:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8490:x1877052324085376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096721.317543:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8490:x1877052324085376:12345-0@lo:502:llog_process_th.0 Request processed in 163us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096721.317551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790096721.318903:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb938600 going to sleep for 11 seconds 00000100:00100000:0.0:1790096721.318947:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8490:1877052324085376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790096721.319002:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096721.319017:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096721.319021:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790096721.319028:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790096721.319075:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8490:1877052324085504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096721.319147:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096721.319864:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14600 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.322509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085504 00000100:00100000:2.0:1790096721.322578:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085504 00000100:00100000:2.0:1790096721.322699:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790096721.322711:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8490:x1877052324085504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096721.323668:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8490:x1877052324085504:12345-0@lo:502:llog_process_th.0 Request processed in 955us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.323680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790096721.323723:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8490:1877052324085504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096721.323776:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096721.323794:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096721.323796:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790096721.323802:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790096721.323916:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1790096721.323943:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790096721.323957:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.323971:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096721.323984:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790096721.323995:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eaac97d4d40 from 1 10000000:01000000:1.0:1790096721.323999:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790096721.324047:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.324056:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.324068:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.324096:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.324144:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.324223:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.324296:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085632 00000100:00100000:2.0:1790096721.324304:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085632 00000100:00100000:2.0:1790096721.324419:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790096721.324428:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324085632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096721.324442:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096721.324459:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac1539400/0xcc97d9eae5ab591b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5914 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.324508:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac1539400/0xcc97d9eae5ab591b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5914 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.324521:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac1539400/0xcc97d9eae5ab591b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5914 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096721.324532:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac1539400, rc 0) 00000100:00100000:2.0:1790096721.324578:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324085632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096721.324584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790096721.324694:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096721.324717:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.324727:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096721.324790:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096721.324817:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096721.324848:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac58fcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790096721.324904:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324085760 00000100:00100000:2.0:1790096721.324909:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324085760 00000100:00100000:2.0:1790096721.324940:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790096721.324947:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324085760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096721.325215:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324085760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790096721.325223:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790096721.325327:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324085760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790096721.325429:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790096721.325437:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096721.325458:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096721.469384:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790096722.340991:0:8527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5c2949f0 20000000:00000080:1.0:1790096722.341019:0:8527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaafb837000 uarg=0000000000000000 20000000:01000000:1.0:1790096722.341082:0:8527:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790096722.341208:0:8527:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790096722.341215:0:8527:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790096722.342454:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1790096722.342747:0:8527:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790096722.347990:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790096722.348077:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790096722.348165:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790096722.348190:0:8527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790096722.348218:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348241:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348260:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348266:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348278:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348285:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348356:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.348374:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 9 pid: 5846 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.348392:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324085888:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096722.349491:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.349567:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 18 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.349584:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086016:0@lo:104: 00000100:00100000:1.0:1790096722.349682:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096722.349718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086016 00010000:00010000:1.0:1790096722.349725:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096722.349727:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086016 00010000:00010000:1.0:1790096722.349733:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 18 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.349741:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086144:0@lo:104: 00000100:00100000:1.0:1790096722.349768:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096722.349838:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096722.349841:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1790096722.349848:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 18 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096722.349853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086144 00000100:00100000:3.0:1790096722.349856:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086144 00000100:00100000:1.0:1790096722.349869:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086272:0@lo:104: 00000100:00100000:3.0:1790096722.349873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790096722.349884:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8527:x1877052324086016:12345-0@lo:104: 00000100:00100000:1.0:1790096722.349889:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790096722.349899:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.349899:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30f2840 going to sleep for 11 seconds 00010000:00010000:3.0:1790096722.349967:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790096722.349974:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8527:x1877052324086016:12345-0@lo:104: Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096722.349982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790096722.350001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086272 00000100:00100000:3.0:1790096722.350004:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086272 00000100:00100000:3.0:1790096722.350017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790096722.350021:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb13d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8527:x1877052324086144:12345-0@lo:104: 00010000:00010000:3.0:1790096722.350029:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350071:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790096722.350076:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb13d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:8527:x1877052324086144:12345-0@lo:104: Request processed in 54us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096722.350082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790096722.350124:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096722.350137:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:8527:x1877052324086272:12345-0@lo:104: 00010000:00010000:3.0:1790096722.350146:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350181:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790096722.350186:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:8527:x1877052324086272:12345-0@lo:104: Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096722.350192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1790096722.350211:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790096722.350218:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.350225:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086016:0@lo:104: 00010000:00010000:3.0:1790096722.350226:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096722.350231:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096722.350233:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086144:0@lo:104: 00000100:00100000:1.0:1790096722.350239:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324086272:0@lo:104: 00010000:00010000:3.0:1790096722.350242:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096722.350250:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096722.350257:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096722.350293:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350301:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096722.350322:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350341:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1538800/0xcc97d9eae5ab57bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab57c4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350355:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096722.350356:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096722.350358:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350362:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350364:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1486000 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096722.350367:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350369:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0031000 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096722.350372:0:7651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350375:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350379:0:7651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096722.350382:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096722.350387:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1790096722.350387:0:7651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096722.350391:0:7651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096722.350410:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350416:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096722.350423:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350429:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1486000/0xcc97d9eae5ab56f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab56f9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350442:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096722.350449:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096722.350451:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096722.350452:0:7651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350457:0:7651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096722.350458:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096722.350471:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324086400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096722.350475:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350481:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0031000/0xcc97d9eae5ab5690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350497:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096722.350499:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096722.350501:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096722.350513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096722.350517:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096722.350527:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324086656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096722.350532:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096722.350536:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324086528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096722.350556:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096722.350572:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086400 00000100:00100000:0.0:1790096722.350577:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086400 00000100:00100000:3.0:1790096722.350587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086528 00000100:00100000:3.0:1790096722.350590:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086528 00010000:00010000:0.0:1790096722.350598:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 20 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350601:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 20 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096722.350653:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096722.350657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790096722.350660:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3316:x1877052324086400:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096722.350662:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3316:x1877052324086528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096722.350671:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096722.350671:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096722.350677:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 20 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350677:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 20 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350688:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 20 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350770:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 20 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350852:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1487c00/0xcc97d9eae5ab56f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab56f2 expref: 20 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096722.350852:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486400/0xcc97d9eae5ab57c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab57bd expref: 20 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.350867:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096722.350867:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096722.350906:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3316:x1877052324086528:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096722.350906:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3316:x1877052324086400:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096722.350913:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096722.350916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790096722.350944:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096722.350997:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324086528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096722.351006:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324086400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096722.351050:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086656 00000100:00100000:0.0:1790096722.351054:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086656 00010000:00010000:0.0:1790096722.351068:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 17 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096722.351109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790096722.351117:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:3315:x1877052324086656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096722.351125:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096722.351129:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 17 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.351139:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 17 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.351149:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486e00/0xcc97d9eae5ab5697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5690 expref: 17 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096722.351158:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096722.351234:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3315:x1877052324086656:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096722.351240:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096722.351305:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324086656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096722.360056:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096722.360255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184384 00000100:00100000:1.0:1790096722.360256:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877052324085888:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096722.360267:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184384 00010000:00010000:1.0:1790096722.360313:0:8527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360321:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096722.360380:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790096722.360392:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2363:x1877052305184384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096722.360435:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096722.360443:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360457:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360482:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5881 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df7 expref: 10 pid: 5846 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360747:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360779:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360787:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360795:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360802:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360808:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096722.360812:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360833:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360856:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096722.360868:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096722.360945:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:2363:x1877052305184384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 552us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096722.360955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00010000:00010000:1.0:1790096722.361587:0:8527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.361607:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.361613:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab5922 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096722.500710:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096722.812987:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324086784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096722.813095:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096722.813239:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086784 00000100:00100000:0.0:1790096722.813256:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086784 00000100:00100000:0.0:1790096722.813329:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096722.813356:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324086784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790096722.813404:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096722.813469:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324086784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096722.813476:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790096722.813721:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790096722.813795:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe98e00 x1877052324086784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096722.813818:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324086784:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1790096723.010719:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790096723.010730:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff322800 from 4 10000000:01000000:0.0:1790096723.010738:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790096723.010800:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096723.010816:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096723.010830:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096723.010864:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324086912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.010958:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096723.011024:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096723.011145:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324086912 00000100:00100000:2.0:1790096723.011156:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324086912 00000100:00100000:2.0:1790096723.011227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790096723.011238:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324086912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096723.011257:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096723.011273:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5929 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096723.011303:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096723.011318:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096723.011328:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096723.011384:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324086912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096723.011414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790096723.011595:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324086912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096723.011613:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096723.011632:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096723.011738:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.011781:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096723.011805:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.011938:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087040 00000100:00100000:1.0:1790096723.011944:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087040 00000100:00100000:1.0:1790096723.011979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790096723.011987:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324087040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.013087:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324087040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1092us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.013099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790096723.014352:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.014440:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.014527:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096723.014582:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096723.014765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087168 00000100:00100000:2.0:1790096723.014774:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087168 00000100:00100000:2.0:1790096723.014840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790096723.014851:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324087168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096723.015110:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324087168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096723.015117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790096723.015540:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.030897:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8546:1877052324087296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.031025:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.031076:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.031222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087296 00000100:00100000:1.0:1790096723.031234:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087296 00000100:00100000:1.0:1790096723.031303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790096723.031315:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8546:x1877052324087296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096723.031631:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8546:x1877052324087296:12345-0@lo:502:llog_process_th.0 Request processed in 318us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.031668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790096723.032549:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8546:1877052324087296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.032595:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096723.032608:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.032612:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790096723.032631:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaaff322800 00000020:00000080:3.0:1790096723.033307:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790096723.034143:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8546:1877052324087424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.034256:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.034320:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a2e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.034722:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087424 00000100:00100000:1.0:1790096723.034733:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087424 00000100:00100000:1.0:1790096723.034802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790096723.034814:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8546:x1877052324087424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096723.035117:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:8546:x1877052324087424:12345-0@lo:502:llog_process_th.0 Request processed in 305us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.035126:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790096723.036702:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8546:1877052324087424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.036754:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096723.036765:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.036767:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790096723.036773:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790096723.036890:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790096723.036916:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096723.036930:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.037092:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096723.037107:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790096723.037110:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac4279800 from 4 10000000:01000000:1.0:1790096723.037113:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096723.037155:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.037164:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.037176:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096723.037201:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.037270:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096723.037320:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30f2000 going to sleep for 11 seconds 00000100:00100000:3.0:1790096723.037353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087552 00000100:00100000:3.0:1790096723.037361:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087552 00000100:00100000:3.0:1790096723.037407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790096723.037416:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324087552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096723.037504:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096723.037521:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5937 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.037551:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.037563:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.037572:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ee00, rc 0) 00000100:00100000:3.0:1790096723.037628:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324087552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.037988:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096723.038005:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.038015:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096723.038087:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.038118:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096723.043931:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.045107:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087680 00000100:00100000:1.0:1790096723.045125:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087680 00000100:00100000:1.0:1790096723.045183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790096723.045193:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324087680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.045558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790096723.047324:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324087680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2122us (9195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.047340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790096723.047446:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.047529:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.047587:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096723.047658:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30f2000 going to sleep for 11 seconds 00000100:00100000:3.0:1790096723.047662:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087808 00000100:00100000:3.0:1790096723.047671:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087808 00000100:00100000:3.0:1790096723.047727:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790096723.047737:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324087808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.047931:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324087808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096723.047948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790096723.048041:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324087808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.049157:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8549:1877052324087936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.049321:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.049365:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.049490:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324087936 00000100:00100000:1.0:1790096723.049498:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324087936 00000100:00100000:1.0:1790096723.049547:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790096723.049556:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8549:x1877052324087936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096723.049817:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8549:x1877052324087936:12345-0@lo:502:llog_process_th.0 Request processed in 261us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.049825:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790096723.050721:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8549:1877052324087936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.050774:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096723.050787:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.050790:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790096723.050799:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac4279800 00000020:00000080:3.0:1790096723.050802:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790096723.053697:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8549:1877052324088064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.053815:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.053868:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028480 going to sleep for 11 seconds 00000100:00100000:1.0:1790096723.056622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088064 00000100:00100000:1.0:1790096723.056661:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088064 00000100:00100000:1.0:1790096723.056743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790096723.056756:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8549:x1877052324088064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096723.057107:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:8549:x1877052324088064:12345-0@lo:502:llog_process_th.0 Request processed in 353us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096723.057124:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790096723.057313:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8549:1877052324088064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.057363:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096723.057375:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.057378:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790096723.057385:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790096723.058541:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790096723.058577:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096723.058593:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.058608:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096723.058659:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790096723.058664:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac41f3800 from 4 10000000:01000000:1.0:1790096723.058667:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096723.058724:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.058734:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096723.058746:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096723.058774:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096723.058843:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096723.058895:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1790096723.058996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088192 00000100:00100000:3.0:1790096723.059006:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088192 00000100:00100000:3.0:1790096723.059056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790096723.059066:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324088192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096723.059081:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096723.059097:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5945 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.059125:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.059144:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.059155:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ea00, rc 0) 00000100:00100000:3.0:1790096723.059202:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324088192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096723.059209:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790096723.059259:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096723.059275:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.059283:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096723.059349:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.059375:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.059395:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6028600 going to sleep for 11 seconds 00000100:00100000:3.0:1790096723.059408:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088320 00000100:00100000:3.0:1790096723.059412:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088320 00000100:00100000:3.0:1790096723.061694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790096723.061718:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324088320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.062178:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324088320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096723.062187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790096723.071975:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.072093:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096723.072216:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096723.072290:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096723.074668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088448 00000100:00100000:2.0:1790096723.074688:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088448 00000100:00100000:2.0:1790096723.074762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790096723.074774:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324088448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096723.075099:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324088448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096723.075109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790096723.075294:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324088448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096723.081418:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8551:1877052324088576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.081547:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.081609:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096723.081735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088576 00000100:00100000:2.0:1790096723.081746:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088576 00000100:00100000:2.0:1790096723.081809:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790096723.081819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:8551:x1877052324088576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096723.082118:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:8551:x1877052324088576:12345-0@lo:502:llog_process_th.0 Request processed in 299us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096723.082127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790096723.082292:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8551:1877052324088576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.082340:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096723.082354:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.082357:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790096723.082365:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac41f3800 00000020:00000080:3.0:1790096723.082368:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790096723.082475:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8551:1877052324088704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096723.082521:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096723.082560:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096723.086360:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088704 00000100:00100000:0.0:1790096723.086381:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088704 00000100:00100000:0.0:1790096723.086449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790096723.086462:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:8551:x1877052324088704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096723.086874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:8551:x1877052324088704:12345-0@lo:502:llog_process_th.0 Request processed in 415us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096723.086884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790096723.088083:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:8551:1877052324088704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096723.088146:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096723.088158:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096723.088161:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790096723.088167:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790096723.088495:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790096723.088520:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790096723.088536:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096723.088568:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096723.519506:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096724.329320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096724.329417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184512 00000100:00100000:0.0:1790096724.329431:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184512 00000100:00100000:0.0:1790096724.329506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1790096724.329518:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:5601:x1877052305184512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096724.329541:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096724.329567:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e36 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096724.329663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096724.329676:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096724.329686:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690800, rc 0) 00000100:00100000:0.0:1790096724.329750:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096724.329758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:1.0:1790096724.334152:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096724.334749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184640 00000100:00100000:2.0:1790096724.334765:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184640 00000100:00100000:2.0:1790096724.334841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:2.0:1790096724.334853:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096724.335230:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 377us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.335240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:2.0:1790096724.338817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096724.338908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184768 00000100:00100000:1.0:1790096724.338922:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184768 00000100:00100000:1.0:1790096724.338986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1790096724.338998:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096724.339309:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:5601:x1877052305184768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 311us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096724.339318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1790096724.343898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096724.344020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305184896 00000100:00100000:0.0:1790096724.344034:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305184896 00000100:00100000:0.0:1790096724.344094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1790096724.344106:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:6138:x1877052305184896:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790096724.344422:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:6138:x1877052305184896:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 317us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096724.344430:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1790096724.348490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096724.348572:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185024 00000100:00100000:2.0:1790096724.348586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185024 00000100:00100000:2.0:1790096724.348686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1790096724.348699:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:6138:x1877052305185024:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096724.349025:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:6138:x1877052305185024:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 328us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.349035:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00010000:00010000:3.0:1790096724.541281:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096724.860859:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324088832:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.860968:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861033:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324089344:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861067:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861099:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790096724.861114:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324088960:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861141:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861158:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324089472:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861185:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861215:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089216:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861243:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096724.861270:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324089088:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861298:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096724.861335:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088832 00000100:00100000:2.0:1790096724.861345:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088832 00000100:00100000:2.0:1790096724.861401:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790096724.861411:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324088832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861471:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324088832:12345-0@lo:400:kworker.0 Request processed in 60us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.861478:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790096724.861533:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089344 00000100:00100000:2.0:1790096724.861538:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089344 00000100:00100000:2.0:1790096724.861583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324088960 00000100:00100000:2.0:1790096724.861587:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324088960 00000100:00100000:2.0:1790096724.861612:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089088 00000100:00100000:2.0:1790096724.861616:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089088 00000100:00100000:2.0:1790096724.861659:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790096724.861668:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324089344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861703:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324089344:12345-0@lo:400:kworker.0 Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.861708:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790096724.861727:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790096724.861733:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324088960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861762:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324088960:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.861768:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790096724.861779:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790096724.861785:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324089088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861815:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324089088:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.861822:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790096724.861847:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089472 00000100:00100000:2.0:1790096724.861850:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089472 00000100:00100000:2.0:1790096724.861881:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089216 00000100:00100000:2.0:1790096724.861884:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089216 00000100:00100000:2.0:1790096724.861908:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096724.861914:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324089472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861946:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324089472:12345-0@lo:400:kworker.0 Request processed in 32us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.861952:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096724.861964:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790096724.861970:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.861996:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089216:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096724.862002:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790096724.862026:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096724.862031:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096724.862034:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096724.862085:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324089088:0@lo:400:kworker.0 00010000:00080000:2.0:1790096724.862100:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe98000 x1877052324089216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096724.862111:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089216:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.862145:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324088960:0@lo:400:kworker.0 00010000:00080000:2.0:1790096724.862160:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe99180 x1877052324089472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096724.862169:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324089472:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.862180:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324088832:0@lo:400:kworker.0 00000100:00100000:2.0:1790096724.862190:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324089344:0@lo:400:kworker.0 00000100:00100000:2.0:1790096725.376921:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096725.381184:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096725.381307:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096725.381851:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089600 00000100:00100000:0.0:1790096725.381865:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089600 00000100:00100000:0.0:1790096725.381982:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096725.381995:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096725.382048:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096725.382122:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096725.382149:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790096725.382228:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3ea680 x1877052324089600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096725.382260:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096725.567945:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096725.680734:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096725.680860:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096725.680905:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096725.680945:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096725.682746:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185152 00000100:00100000:0.0:1790096725.682764:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185152 00000100:00100000:0.0:1790096725.682860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1790096725.682874:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2362:x1877052305185152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096725.682994:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2362:x1877052305185152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 122us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096725.683002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:2.0:1790096725.683919:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185536 00000100:00100000:2.0:1790096725.683933:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185536 00000100:00100000:2.0:1790096725.684025:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185408 00000100:00100000:2.0:1790096725.684045:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185408 00000100:00100000:2.0:1790096725.684073:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790096725.684081:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305185536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096725.684156:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305185536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 75us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096725.684164:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790096725.684181:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790096725.684187:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305185408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096725.684207:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2362:x1877052305185408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (3262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096725.684212:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096725.685743:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185280 00000100:00100000:1.0:1790096725.685758:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185280 00000100:00080000:0.0:1790096725.686178:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096725.686189:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096725.686190:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00080000:0.0:1790096725.686194:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096725.686206:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305185280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096725.686304:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305185280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 104us (5587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096725.686312:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00010000:00010000:1.0:1790096726.601081:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096727.614610:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096727.933444:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096727.933514:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096727.933605:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089728 00000100:00100000:1.0:1790096727.933614:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089728 00000100:00100000:1.0:1790096727.933707:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790096727.933716:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096727.933749:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096727.934047:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324089728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096727.934055:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790096727.934108:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe98000 x1877052324089728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096727.934269:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324089728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790096727.934294:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790096728.636859:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790096728.940736:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1790096729.660853:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096729.980985:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324089984:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981055:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981271:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324090496:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981318:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981354:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790096729.981374:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324089856:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981409:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981428:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324090368:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981446:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981471:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324090240:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981492:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981508:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096729.981512:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324090112:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981533:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096729.981559:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089984 00000100:00100000:0.0:1790096729.981576:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089984 00000100:00100000:0.0:1790096729.981617:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090368 00000100:00100000:0.0:1790096729.981619:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090368 00000100:00100000:0.0:1790096729.981677:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090112 00000100:00100000:0.0:1790096729.981680:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090112 00000100:00100000:0.0:1790096729.981695:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790096729.981703:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324089984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981754:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324089984:12345-0@lo:400:kworker.0 Request processed in 51us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096729.981761:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790096729.981778:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096729.981784:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324090368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.981810:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324090368:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096729.981815:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096729.982040:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790096729.982048:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324090112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.982100:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324090112:12345-0@lo:400:kworker.0 Request processed in 54us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096729.982107:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790096729.982135:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096729.982163:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324090368:0@lo:400:kworker.0 00000100:00100000:0.0:1790096729.982173:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324089984:0@lo:400:kworker.0 00000100:00100000:2.0:1790096729.982259:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090496 00000100:00100000:2.0:1790096729.982264:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090496 00000100:00100000:2.0:1790096729.982303:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090240 00000100:00100000:2.0:1790096729.982307:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090240 00000100:00100000:2.0:1790096729.982326:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790096729.982332:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324090496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096729.982371:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324090496:12345-0@lo:400:kworker.0 Request processed in 39us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096729.982377:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790096729.982393:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790096729.982399:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324090240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096729.982424:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324090240:12345-0@lo:400:kworker.0 Request processed in 26us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096729.982430:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790096729.982446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324089856 00000100:00100000:2.0:1790096729.982456:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324089856 00000100:00100000:2.0:1790096729.982481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790096729.982487:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324089856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096729.982517:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324089856:12345-0@lo:400:kworker.0 Request processed in 31us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096729.982523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790096729.982958:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324090112:0@lo:400:kworker.0 00010000:00080000:3.0:1790096729.982972:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e8e00 x1877052324090240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096729.982981:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324090240:0@lo:400:kworker.0 00000100:00080000:0.0:1790096729.983146:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790096729.983150:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096729.983610:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324089856:0@lo:400:kworker.0 00010000:00080000:2.0:1790096729.983624:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3eb800 x1877052324090496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096729.983656:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324090496:0@lo:400:kworker.0 00000100:00100000:3.0:1790096730.493665:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096730.493712:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324090624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096730.493790:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096730.493947:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090624 00000100:00100000:1.0:1790096730.493956:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090624 00000100:00100000:1.0:1790096730.494013:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790096730.494023:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324090624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096730.494060:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096730.494118:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324090624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096730.494132:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790096730.495558:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3eb100 x1877052324090624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096730.495608:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324090624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790096730.686422:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096730.803119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096730.803186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096730.803215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096730.803249:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096730.803251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185664 00000100:00100000:1.0:1790096730.803265:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185664 00000100:00100000:0.0:1790096730.803279:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185792 00000100:00100000:0.0:1790096730.803285:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185792 00000100:00100000:1.0:1790096730.803343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790096730.803343:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096730.803363:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305185792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096730.803364:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305185664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096730.803491:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305185920 00000100:00100000:3.0:1790096730.803496:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305185920 00000100:00100000:3.0:1790096730.803535:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186048 00000100:00100000:3.0:1790096730.803538:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186048 00000100:00100000:3.0:1790096730.803573:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790096730.803582:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305185920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096730.803685:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305185792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 328us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096730.803694:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096730.803744:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096730.803753:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305186048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096730.806985:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305185664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3610us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096730.807004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00080000:1.0:1790096730.808722:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096730.808734:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096730.808739:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096730.810919:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305185920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7320us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096730.810938:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1790096730.812548:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305186048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 8772us (9273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096730.812573:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:0.0:1790096731.708855:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096732.733474:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096733.056729:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096733.056751:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324090752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096733.056815:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096733.056889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090752 00000100:00100000:2.0:1790096733.056897:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090752 00000100:00100000:2.0:1790096733.056952:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790096733.056961:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324090752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096733.056996:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096733.057040:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324090752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096733.057048:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1790096733.057076:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096733.057107:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9b100 x1877052324090752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096733.057123:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324090752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790096733.760843:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096734.125881:0:9071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing yml_node 00010000:00010000:0.0:1790096734.785477:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096735.108615:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324090880:0@lo:400:kworker.0 00000100:00100000:0.0:1790096735.108774:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096735.108948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324090880 00000100:00100000:2.0:1790096735.108958:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324090880 00000100:00100000:2.0:1790096735.109005:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790096735.109015:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324090880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109683:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324091008:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109722:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096735.109749:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324091520:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109773:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096735.109794:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096735.109799:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324091392:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109819:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096735.109864:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091264:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109888:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096735.109906:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096735.109913:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324091136:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.109935:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096735.109974:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091008 00000100:00100000:1.0:1790096735.109979:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091008 00000100:00100000:1.0:1790096735.110009:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091392 00000100:00100000:1.0:1790096735.110012:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091392 00000100:00100000:1.0:1790096735.110034:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091136 00000100:00100000:1.0:1790096735.110037:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091136 00000100:00100000:1.0:1790096735.110052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790096735.110058:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324091008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110098:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324091008:12345-0@lo:400:kworker.0 Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.110105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790096735.110120:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790096735.110126:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110152:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324091392:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.110158:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790096735.110170:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790096735.110175:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324091136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110205:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324091136:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.110211:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790096735.110228:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091520 00000100:00100000:1.0:1790096735.110232:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091520 00000100:00100000:1.0:1790096735.110256:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091264 00000100:00100000:1.0:1790096735.110258:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091264 00000100:00100000:1.0:1790096735.110275:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096735.110281:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110310:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324091520:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.110322:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096735.110334:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790096735.110339:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110368:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091264:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.110374:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790096735.110398:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096735.110401:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096735.110404:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096735.110431:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324091392:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110441:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324091008:0@lo:400:kworker.0 00010000:00080000:1.0:1790096735.110452:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6ce00 x1877052324091520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096735.110462:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324091520:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.110492:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324091136:0@lo:400:kworker.0 00010000:00080000:1.0:1790096735.110501:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6c000 x1877052324091264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096735.110510:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091264:0@lo:400:kworker.0 00000100:00100000:2.0:1790096735.111106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324090880:12345-0@lo:400:kworker.0 Request processed in 2089us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096735.111115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790096735.116559:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324090880:0@lo:400:kworker.0 00000100:00100000:1.0:1790096735.613352:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096735.613376:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096735.613439:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096735.613584:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091648 00000100:00100000:2.0:1790096735.613592:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091648 00000100:00100000:2.0:1790096735.613661:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790096735.613670:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096735.613704:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096735.613747:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096735.613754:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1790096735.613826:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e8a80 x1877052324091648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096735.613875:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096735.812878:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096735.929218:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096735.929283:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096735.929317:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096735.929349:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096735.929380:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186432 00000100:00100000:1.0:1790096735.929388:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186432 00000100:00100000:1.0:1790096735.929439:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186560 00000100:00100000:1.0:1790096735.929442:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186560 00000100:00100000:1.0:1790096735.929464:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790096735.929474:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2359:x1877052305186432:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:1.0:1790096735.929510:0:7012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab588f 00000100:00080000:1.0:1790096735.929530:0:7012:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790096735.929568:0:7012:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790096735.930010:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186304 00000100:00100000:0.0:1790096735.930015:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186304 00000100:00100000:0.0:1790096735.930052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096735.930059:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305186304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096735.930122:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305186304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096735.930129:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096735.930268:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790096735.930275:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2359:x1877052305186560:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1790096735.930296:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5896 00000100:00080000:0.0:1790096735.930302:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9eaaff326000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790096735.930326:0:6695:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790096735.930545:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+2:2359:x1877052305186560:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 269us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096735.930551:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:0.0:1790096735.930573:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096735.930577:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096735.930579:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790096735.930587:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096735.930697:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096735.931286:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186176 00000100:00100000:2.0:1790096735.931294:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186176 00000100:00100000:2.0:1790096735.931339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:2.0:1790096735.931347:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2363:x1877052305186176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096735.931394:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2363:x1877052305186176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 48us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096735.931417:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:1.0:1790096735.931578:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+2:2359:x1877052305186432:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 2103us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096735.931587:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00010000:00010000:0.0:1790096736.828870:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096737.853571:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096738.176448:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096738.176538:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096738.176618:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091776 00000100:00100000:2.0:1790096738.176626:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091776 00000100:00100000:2.0:1790096738.176705:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790096738.176716:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096738.176756:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096738.176815:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324091776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096738.176821:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1790096738.176844:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096738.176879:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9b100 x1877052324091776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096738.176900:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324091776:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790096738.339750:0:9264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00010000:00010000:0.0:1790096738.878834:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790096739.755225:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:3.0:1790096739.755241:0:7663:0:(genops.c:885:class_export_put()) final put ffff9eaaff325000/7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:1.0:1790096739.755329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff325000/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-OST0001 00000020:00000080:1.0:1790096739.755402:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff326000 for lustre-OST0001 00010000:00010000:1.0:1790096739.901753:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096740.221181:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324092032:0@lo:400:kworker.0 00000100:00100000:3.0:1790096740.221251:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324092160:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221278:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096740.221287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092288:0@lo:400:kworker.0 00000100:00100000:3.0:1790096740.221315:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.221342:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324092544:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221363:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.221383:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790096740.221390:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324091904:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221419:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.221442:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324092416:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221463:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.221512:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092032 00000100:00100000:0.0:1790096740.221522:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092032 00000100:00100000:0.0:1790096740.221574:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092416 00000100:00100000:0.0:1790096740.221577:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092416 00000100:00100000:0.0:1790096740.221614:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790096740.221623:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221707:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324092032:12345-0@lo:400:kworker.0 Request processed in 84us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.221715:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790096740.221734:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790096740.221740:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324092416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221766:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324092416:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.221771:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790096740.221792:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092288 00000100:00100000:0.0:1790096740.221795:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092288 00000100:00100000:0.0:1790096740.221822:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092544 00000100:00100000:0.0:1790096740.221831:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092544 00000100:00100000:0.0:1790096740.221856:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790096740.221861:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221903:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092288:12345-0@lo:400:kworker.0 Request processed in 40us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.221909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790096740.221920:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790096740.221926:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324092544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.221951:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324092544:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.221957:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790096740.221981:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324091904 00000100:00100000:0.0:1790096740.221984:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324091904 00000100:00100000:0.0:1790096740.222008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790096740.222014:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222043:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324091904:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.222049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1790096740.222087:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096740.222092:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790096740.222095:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790096740.222136:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff781880 x1877052324092288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096740.222151:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092288:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222184:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.222221:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092160 00000100:00100000:0.0:1790096740.222225:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092160 00000100:00100000:0.0:1790096740.222259:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790096740.222264:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324092160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222298:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324092160:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.222303:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790096740.222315:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096740.222332:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324092160:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222357:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324091904:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222368:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324092416:0@lo:400:kworker.0 00000100:00100000:0.0:1790096740.222379:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324092032:0@lo:400:kworker.0 00010000:00080000:0.0:1790096740.222389:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff782d80 x1877052324092544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096740.222397:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324092544:0@lo:400:kworker.0 00000001:00100000:2.0:1790096740.312563:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:2.0:1790096740.312574:0:6721:0:(genops.c:885:class_export_put()) final put ffff9eaaff5d1800/7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:0.0:1790096740.312666:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff5d1800/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-OST0000 00000020:00000080:0.0:1790096740.312740:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff5d4000 for lustre-OST0000 00000100:00100000:0.0:1790096740.741811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096740.741846:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096740.741952:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096740.742064:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092672 00000100:00100000:0.0:1790096740.742075:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092672 00000100:00100000:0.0:1790096740.742138:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790096740.742150:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096740.742202:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096740.742257:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096740.742284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790096740.742335:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3eb800 x1877052324092672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096740.742367:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096740.927081:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096740.969848:0:9363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00000100:00100000:0.0:1790096741.037718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096741.037780:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096741.038030:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186816 00000100:00100000:1.0:1790096741.038044:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186816 00000100:00100000:1.0:1790096741.038148:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1790096741.038160:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305186816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096741.038259:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305186816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096741.038282:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00080000:3.0:1790096741.040254:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096741.043326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186688 00000100:00100000:3.0:1790096741.043346:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186688 00000100:00100000:3.0:1790096741.043425:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:3.0:1790096741.043436:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305186688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096741.043544:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305186688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 108us (5762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096741.043552:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00010000:00010000:0.0:1790096741.948917:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096742.976047:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096743.293977:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096743.294087:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096743.294334:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092800 00000100:00100000:2.0:1790096743.294347:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092800 00000100:00100000:2.0:1790096743.294433:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790096743.294444:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790096743.294484:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790096743.294500:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096743.294565:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324092800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096743.294594:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790096743.294605:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9b100 x1877052324092800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096743.294628:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324092800:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790096743.611082:0:9460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00010000:00010000:1.0:1790096743.998068:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096745.025477:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096745.344753:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324093184:0@lo:400:kworker.0 00000100:00100000:1.0:1790096745.344847:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096745.344920:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096745.344928:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324093312:0@lo:400:kworker.0 00000100:00100000:1.0:1790096745.344957:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096745.345310:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324093056:0@lo:400:kworker.0 00000100:00100000:3.0:1790096745.345369:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096745.345392:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324093568:0@lo:400:kworker.0 00000100:00100000:3.0:1790096745.345418:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096745.345444:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790096745.345460:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324092928:0@lo:400:kworker.0 00000100:00100000:3.0:1790096745.345491:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096745.345513:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324093440:0@lo:400:kworker.0 00000100:00100000:3.0:1790096745.345536:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096745.345687:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093184 00000100:00100000:0.0:1790096745.345699:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093184 00000100:00100000:0.0:1790096745.345769:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093056 00000100:00100000:0.0:1790096745.345773:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093056 00000100:00100000:0.0:1790096745.345793:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093440 00000100:00100000:0.0:1790096745.345795:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093440 00000100:00100000:0.0:1790096745.345813:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790096745.345823:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324093184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.345897:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324093184:12345-0@lo:400:kworker.0 Request processed in 74us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.345905:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790096745.345924:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096745.345930:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324093056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.345960:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324093056:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.345979:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096745.345992:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790096745.345997:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346041:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324093440:12345-0@lo:400:kworker.0 Request processed in 44us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.346047:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790096745.346068:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093312 00000100:00100000:0.0:1790096745.346072:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093312 00000100:00100000:0.0:1790096745.346099:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093568 00000100:00100000:0.0:1790096745.346102:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093568 00000100:00100000:0.0:1790096745.346121:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790096745.346128:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324093312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346305:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324093312:12345-0@lo:400:kworker.0 Request processed in 176us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.346313:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790096745.346325:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790096745.346332:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346428:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324093568:12345-0@lo:400:kworker.0 Request processed in 97us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.346434:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790096745.346478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324092928 00000100:00100000:0.0:1790096745.346483:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324092928 00000100:00100000:0.0:1790096745.346506:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790096745.346513:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324092928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346546:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324092928:12345-0@lo:400:kworker.0 Request processed in 32us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.346563:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790096745.346674:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324092928:0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346690:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324093440:0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346700:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324093056:0@lo:400:kworker.0 00010000:00080000:0.0:1790096745.346712:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaeefd7b80 x1877052324093568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096745.346723:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324093568:0@lo:400:kworker.0 00010000:00080000:0.0:1790096745.346767:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6dc00 x1877052324093312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096745.346777:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324093312:0@lo:400:kworker.0 00000100:00100000:0.0:1790096745.346787:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324093184:0@lo:400:kworker.0 00000100:00080000:3.0:1790096745.347312:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096745.347318:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096745.347322:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790096745.683132:0:9510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 22 13:05:43 EDT 2026 00000100:00100000:0.0:1790096745.853870:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096745.853902:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324093696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096745.853994:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096745.854081:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093696 00000100:00100000:0.0:1790096745.854093:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093696 00000100:00100000:0.0:1790096745.854154:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790096745.854164:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324093696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096745.854212:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096745.854260:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324093696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096745.854269:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1790096745.854330:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e9c00 x1877052324093696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096745.854351:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324093696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096746.045023:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096746.155295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096746.155496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096746.156077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305186944 00000100:00100000:1.0:1790096746.156092:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305186944 00000100:00100000:1.0:1790096746.156170:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:1.0:1790096746.156182:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305186944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096746.156288:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305186944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 108us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096746.156297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1790096746.156461:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187072 00000100:00100000:0.0:1790096746.156466:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187072 00000100:00100000:0.0:1790096746.156522:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:0.0:1790096746.156530:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305187072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096746.156566:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305187072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096746.156572:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00080000:1.0:1790096746.156661:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790096747.069231:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096748.096817:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096748.413997:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324093824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096748.414079:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096748.414188:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093824 00000100:00100000:0.0:1790096748.414197:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093824 00000100:00100000:0.0:1790096748.414256:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790096748.414265:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324093824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790096748.414300:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096748.414346:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324093824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096748.414353:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790096748.414408:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6dc00 x1877052324093824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096748.414427:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324093824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790096748.414665:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790096749.123525:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096750.140859:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096750.461001:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324094080:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461070:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096750.461116:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324094592:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461139:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096750.461170:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790096750.461176:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324093952:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461201:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096750.461219:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324094464:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461239:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096750.461251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324093952 00000100:00100000:2.0:1790096750.461259:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324093952 00000100:00100000:3.0:1790096750.461263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324094208:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461295:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096750.461345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790096750.461354:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324093952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096750.461406:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324093952:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096750.461413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790096750.461441:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094080 00000100:00100000:1.0:1790096750.461451:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094080 00000100:00100000:2.0:1790096750.461473:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324093952:0@lo:400:kworker.0 00000100:00100000:1.0:1790096750.461479:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094464 00000100:00100000:1.0:1790096750.461481:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094464 00000100:00100000:1.0:1790096750.461507:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094208 00000100:00080000:2.0:1790096750.461510:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096750.461510:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094208 00000100:00100000:1.0:1790096750.461523:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096750.461529:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324094080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096750.461576:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324094080:12345-0@lo:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096750.461582:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096750.461595:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790096750.461601:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096750.461627:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324094464:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096750.461652:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790096750.461665:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096750.461671:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096750.461696:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324094208:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096750.461701:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790096750.461818:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324094464:0@lo:400:kworker.0 00000100:00100000:2.0:1790096750.461829:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324094080:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461972:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324094208:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.461983:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096750.461989:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324094336:0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.462018:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096750.462064:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094592 00000100:00100000:3.0:1790096750.462067:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094592 00000100:00100000:3.0:1790096750.462097:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094336 00000100:00100000:3.0:1790096750.462100:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094336 00000100:00100000:2.0:1790096750.462100:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790096750.462107:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324094592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096750.462119:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790096750.462123:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324094336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096750.462142:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324094592:12345-0@lo:400:kworker.0 Request processed in 36us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096750.462148:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790096750.462151:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324094336:12345-0@lo:400:kworker.0 Request processed in 28us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096750.462156:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790096750.462163:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096750.462166:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790096750.462181:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaae8d6d500 x1877052324094592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1790096750.462182:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff781f80 x1877052324094336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096750.462194:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324094336:0@lo:400:kworker.0 00000100:00100000:2.0:1790096750.462194:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324094592:0@lo:400:kworker.0 00000100:00100000:2.0:1790096750.974740:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096750.974763:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096750.974826:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096750.975038:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094720 00000100:00100000:0.0:1790096750.975047:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094720 00000100:00100000:0.0:1790096750.975099:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790096750.975116:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324094720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096750.975151:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096750.975193:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324094720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096750.975199:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1790096750.975276:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6dc00 x1877052324094720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096750.975294:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324094720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790096751.164896:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096751.273049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096751.273141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096751.273307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187200 00000100:00100000:0.0:1790096751.273317:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187200 00000100:00100000:3.0:1790096751.273342:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187328 00000100:00100000:3.0:1790096751.273349:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187328 00000100:00100000:0.0:1790096751.273404:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:0.0:1790096751.273425:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305187200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096751.273483:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790096751.273493:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305187328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096751.273498:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2360:x1877052305187200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096751.273508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:3.0:1790096751.273532:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305187328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096751.273541:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00080000:3.0:1790096751.274002:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790096752.191329:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096753.212761:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096753.543420:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324094848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790096753.543489:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096753.543889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094848 00000100:00100000:2.0:1790096753.543898:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094848 00000100:00100000:2.0:1790096753.543962:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790096753.543972:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324094848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096753.544007:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096753.544053:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324094848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096753.544060:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790096753.544115:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790096753.544144:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe98000 x1877052324094848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096753.544163:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324094848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096754.247689:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096755.261975:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096755.580877:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324095232:0@lo:400:kworker.0 00000100:00100000:2.0:1790096755.580947:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096755.580959:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324094976:0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.580998:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096755.581007:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096755.581016:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324095360:0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.581039:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324095488:0@lo:400:kworker.0 00000100:00100000:2.0:1790096755.581063:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096755.581126:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324095104:0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.581327:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096755.581361:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095360 00000100:00100000:2.0:1790096755.581370:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095360 00000100:00100000:0.0:1790096755.581423:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095232 00000100:00100000:0.0:1790096755.581428:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095232 00000100:00100000:2.0:1790096755.581436:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790096755.581447:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324095360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.581463:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095488 00000100:00100000:0.0:1790096755.581467:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095488 00000100:00100000:0.0:1790096755.581490:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790096755.581497:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324095232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.581546:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324094976 00000100:00100000:1.0:1790096755.581550:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324094976 00000100:00100000:0.0:1790096755.581551:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324095232:12345-0@lo:400:kworker.0 Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096755.581557:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790096755.581574:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790096755.581580:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324095488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.581610:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324095488:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096755.581625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790096755.581760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790096755.581768:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.581807:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324094976:12345-0@lo:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096755.581813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790096755.581865:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324094976:0@lo:400:kworker.0 00000100:00100000:1.0:1790096755.581876:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324095488:0@lo:400:kworker.0 00000100:00100000:3.0:1790096755.586166:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096755.586175:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324095360:12345-0@lo:400:kworker.0 Request processed in 4728us (5110us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096755.586210:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790096755.586214:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324095616:0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.586402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095104 00000100:00100000:0.0:1790096755.586412:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095104 00000100:00100000:0.0:1790096755.586454:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790096755.586464:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324095104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.586503:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324095104:12345-0@lo:400:kworker.0 Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096755.586510:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790096755.587032:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff782300 x1877052324095360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096755.587048:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324095360:0@lo:400:kworker.0 00000100:00100000:2.0:1790096755.587063:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324095232:0@lo:400:kworker.0 00000100:00080000:2.0:1790096755.587891:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790096755.587898:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096755.588194:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096755.588925:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324095104:0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.589048:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095616 00000100:00100000:0.0:1790096755.589056:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095616 00000100:00100000:0.0:1790096755.589116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790096755.589125:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324095616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096755.589188:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324095616:12345-0@lo:400:kworker.0 Request processed in 65us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096755.589195:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790096755.589359:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790096755.589875:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff781880 x1877052324095616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096755.589885:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324095616:0@lo:400:kworker.0 00000100:00100000:2.0:1790096756.094810:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324095744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096756.094993:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096756.095084:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095744 00000100:00100000:2.0:1790096756.095092:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095744 00000100:00100000:2.0:1790096756.095365:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790096756.095389:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324095744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096756.095491:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096756.110512:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324095744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15128us (15511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096756.110528:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790096756.112819:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff083480 x1877052324095744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096756.112846:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324095744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096756.285346:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096756.397124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096756.397168:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096756.397196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187456 00000100:00100000:3.0:1790096756.397204:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187456 00000100:00100000:3.0:1790096756.397247:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:3.0:1790096756.397267:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305187456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096756.397345:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305187456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096756.397355:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1790096756.397471:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187584 00000100:00100000:0.0:1790096756.397476:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187584 00000100:00080000:3.0:1790096756.397514:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096756.397524:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790096756.397533:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305187584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096756.397624:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305187584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096756.397631:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00010000:00010000:2.0:1790096757.308784:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096758.332876:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096758.653110:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324095872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096758.653184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096758.653470:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324095872 00000100:00100000:2.0:1790096758.653478:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324095872 00000100:00100000:2.0:1790096758.653545:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790096758.653555:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324095872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096758.653590:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096758.653666:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324095872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096758.653687:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790096758.653800:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff083b80 x1877052324095872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096758.653818:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324095872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790096758.654127:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790096759.357084:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790096760.315134:0:10140:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:05:58 (1790096758) === 00010000:00010000:3.0:1790096760.381995:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096760.700946:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096760.703659:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324096128:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.703735:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096760.703794:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324096000:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.703831:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096760.703847:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324096384:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.703864:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324096640:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.703899:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096760.703927:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096760.703931:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096000 00000100:00100000:1.0:1790096760.703935:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324096512:0@lo:400:kworker.0 00000100:00100000:0.0:1790096760.703941:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096000 00000100:00100000:0.0:1790096760.703989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790096760.703998:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324096000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096760.704050:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324096000:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.704057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790096760.704064:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096760.704096:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096760.704108:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324096000:0@lo:400:kworker.0 00000100:00100000:0.0:1790096760.704128:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096760.704137:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324096256:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.704151:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096640 00000100:00100000:1.0:1790096760.704157:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096640 00000100:00100000:0.0:1790096760.704165:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096760.704265:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096128 00000100:00100000:2.0:1790096760.704270:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096128 00000100:00100000:2.0:1790096760.704304:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096512 00000100:00100000:2.0:1790096760.704308:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096512 00000100:00100000:2.0:1790096760.704326:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096256 00000100:00100000:2.0:1790096760.704328:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096256 00000100:00100000:2.0:1790096760.704356:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790096760.704364:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324096128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.704382:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096384 00000100:00100000:1.0:1790096760.704387:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096384 00000100:00100000:2.0:1790096760.704414:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324096128:12345-0@lo:400:kworker.0 Request processed in 49us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.704419:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790096760.704427:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790096760.704432:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324096640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096760.704449:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790096760.704457:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.704472:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324096640:12345-0@lo:400:kworker.0 Request processed in 43us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.704480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790096760.704498:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790096760.704501:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324096512:12345-0@lo:400:kworker.0 Request processed in 42us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.704509:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324096384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096760.704515:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790096760.704534:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790096760.704543:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324096256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.704548:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324096384:12345-0@lo:400:kworker.0 Request processed in 41us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.704555:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790096760.704609:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324096256:12345-0@lo:400:kworker.0 Request processed in 66us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.704616:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790096760.704622:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324096512:0@lo:400:kworker.0 00010000:00080000:1.0:1790096760.704663:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185b100 x1877052324096640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096760.704675:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324096640:0@lo:400:kworker.0 00000100:00100000:1.0:1790096760.704686:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324096128:0@lo:400:kworker.0 00000100:00080000:3.0:1790096760.704835:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096760.704841:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790096760.704843:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790096760.705028:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324096256:0@lo:400:kworker.0 00010000:00080000:0.0:1790096760.705040:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad1858e00 x1877052324096384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096760.705049:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324096384:0@lo:400:kworker.0 00000100:00100000:3.0:1790096760.735229:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096760.735472:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187712 00000100:00100000:1.0:1790096760.735483:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187712 00000100:00100000:1.0:1790096760.735543:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1790096760.735553:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:8135:x1877052305187712:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790096760.735569:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096760.735599:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17be00/0xcc97d9eae5ab595a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e3d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.735661:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17be00/0xcc97d9eae5ab595a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e3d expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.735674:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17be00/0xcc97d9eae5ab595a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e3d expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.735683:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17be00, rc 0) 00000100:00100000:1.0:1790096760.735751:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305187712:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 199us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.735758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:3.0:1790096760.746846:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.751849:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187840 00000100:00100000:0.0:1790096760.751867:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187840 00000100:00100000:0.0:1790096760.752013:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:0.0:1790096760.752025:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305187840:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790096760.756394:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305187840:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 4360us (9546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.756410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:3.0:1790096760.762454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.765437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305187968 00000100:00100000:0.0:1790096760.765452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305187968 00000100:00100000:0.0:1790096760.765526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:0.0:1790096760.765552:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305187968:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790096760.769133:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305187968:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 3570us (6675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.769148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:3.0:1790096760.774188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.776492:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188096 00000100:00100000:0.0:1790096760.776507:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188096 00000100:00100000:3.0:1790096760.777867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1790096760.777887:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8139:x1877052305188096:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790096760.778327:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8139:x1877052305188096:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 446us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096760.778336:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1790096760.797607:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.797660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188224 00000100:00100000:2.0:1790096760.797674:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188224 00000100:00100000:2.0:1790096760.797846:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:2.0:1790096760.797859:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8139:x1877052305188224:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096760.798171:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8139:x1877052305188224:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 315us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.798179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:0.0:1790096760.808877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096760.809060:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188352 00000100:00100000:3.0:1790096760.809071:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188352 00000100:00100000:3.0:1790096760.809123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1790096760.809133:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:8135:x1877052305188352:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790096760.809148:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096760.809165:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab5961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e67 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096760.809211:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab5961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e67 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096760.809224:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab5961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e67 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096760.809233:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f000, rc 0) 00000100:00100000:3.0:1790096760.809304:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:8135:x1877052305188352:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 171us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096760.809311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1790096760.820513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.820759:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188480 00000100:00100000:2.0:1790096760.820769:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188480 00000100:00100000:2.0:1790096760.820859:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:2.0:1790096760.820871:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:8135:x1877052305188480:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790096760.820896:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790096760.820921:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790096760.820925:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790096760.820929:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790096760.820931:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790096760.823806:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:8135:x1877052305188480:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 2929us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.823819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:0.0:1790096760.832727:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096760.832967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188608 00000100:00100000:1.0:1790096760.832978:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188608 00000100:00100000:1.0:1790096760.834183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:1.0:1790096760.834201:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:8135:x1877052305188608:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790096760.834217:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096760.834236:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e6e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.834280:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.834293:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096760.834303:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a200, rc 0) 00000100:00100000:1.0:1790096760.834368:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8135:x1877052305188608:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 174us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.834392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:3.0:1790096760.840607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.840669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188736 00000100:00100000:2.0:1790096760.840680:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188736 00000100:00100000:2.0:1790096760.840735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:2.0:1790096760.840746:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8135:x1877052305188736:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790096760.841170:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8135:x1877052305188736:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 424us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.841179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:0.0:1790096760.845509:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096760.845812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188864 00000100:00100000:1.0:1790096760.845823:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188864 00000100:00100000:2.0:1790096760.845980:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:2.0:1790096760.845992:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8135:x1877052305188864:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790096760.846484:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8135:x1877052305188864:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 492us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.846500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:0.0:1790096760.851551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096760.851759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305188992 00000100:00100000:3.0:1790096760.851769:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305188992 00000100:00100000:3.0:1790096760.851859:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1790096760.851870:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8143:x1877052305188992:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790096760.852081:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8143:x1877052305188992:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 213us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096760.852086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1790096760.855471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.858828:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189120 00000100:00100000:2.0:1790096760.858842:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189120 00000100:00100000:2.0:1790096760.858955:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:2.0:1790096760.858966:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8143:x1877052305189120:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096760.859310:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:8143:x1877052305189120:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 344us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.859318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:0.0:1790096760.864800:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.864879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096760.865093:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189248 00000100:00100000:1.0:1790096760.865103:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189248 00000100:00100000:1.0:1790096760.865158:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189632 00000100:00100000:1.0:1790096760.865162:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189632 00000100:00100000:1.0:1790096760.865222:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790096760.865232:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305189632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096760.865305:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305189632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096760.865313:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790096760.865331:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790096760.865335:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2359:x1877052305189248:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790096760.865368:0:8484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 56fd0760-a5ee-4811-af5a-739a392b530e@192.168.203.11@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1790096760.865407:0:8484:0:(genops.c:1384:class_connect()) connect: client 56fd0760-a5ee-4811-af5a-739a392b530e, cookie 0xcc97d9eae5ab596f 00000004:00100000:1.0:1790096760.865446:0:8484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790096760.865743:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096760.866453:0:8484:0:(import.c:65:import_set_state_nolock()) ffff9eaaff321800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096760.866516:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+6:2359:x1877052305189248:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1177us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.866526:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790096760.871080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.871189:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189376 00000100:00100000:2.0:1790096760.871199:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189376 00000100:00100000:2.0:1790096760.871282:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790096760.871292:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:0:x1877052305189376:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790096760.871349:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790096760.871451:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:0:x1877052305189376:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.871459:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:0.0:1790096760.872081:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096760.874394:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.874536:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189504 00000100:00100000:0.0:1790096760.874546:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189504 00000100:00100000:0.0:1790096760.874614:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790096760.874624:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305189504:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790096760.874699:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790096760.874770:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305189504:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.874777:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790096760.880482:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096760.880685:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189760 00000100:00100000:2.0:1790096760.880696:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189760 00000100:00100000:2.0:1790096760.880760:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790096760.880770:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305189760:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790096760.880872:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305189760:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096760.880879:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790096760.884387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096760.884440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.884549:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305189888 00000100:00100000:0.0:1790096760.884559:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305189888 00000100:00100000:0.0:1790096760.884598:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190016 00000100:00100000:0.0:1790096760.884602:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190016 00000100:00100000:0.0:1790096760.884627:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790096760.884665:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1877052305189888:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790096760.884696:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 56fd0760-a5ee-4811-af5a-739a392b530e@192.168.203.11@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1790096760.884725:0:6695:0:(genops.c:1384:class_connect()) connect: client 56fd0760-a5ee-4811-af5a-739a392b530e, cookie 0xcc97d9eae5ab5976 00002000:00100000:0.0:1790096760.884735:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 56fd0760-a5ee-4811-af5a-739a392b530e/ffff9eaaff326000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790096760.884758:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790096760.885080:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790096760.885087:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1877052305190016:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790096760.885104:0:7012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 56fd0760-a5ee-4811-af5a-739a392b530e@192.168.203.11@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1790096760.885122:0:7012:0:(genops.c:1384:class_connect()) connect: client 56fd0760-a5ee-4811-af5a-739a392b530e, cookie 0xcc97d9eae5ab597d 00002000:00100000:3.0:1790096760.885141:0:7012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 56fd0760-a5ee-4811-af5a-739a392b530e/ffff9eaaff212800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790096760.885168:0:7012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790096760.885330:0:7012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790096760.885368:0:7012:0:(import.c:65:import_set_state_nolock()) ffff9eaaff216000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790096760.885436:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+6:2359:x1877052305190016:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 347us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096760.885443:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00002000:00080000:0.0:1790096760.887918:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790096760.887961:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9eaaff325000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096760.888452:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56fd0760-a5ee-4811-af5a-739a392b530e+6:2359:x1877052305189888:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 3814us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.888464:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790096760.888577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096760.889467:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190144 00000100:00100000:0.0:1790096760.889477:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190144 00000100:00100000:0.0:1790096760.889526:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790096760.889535:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305190144:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790096760.889609:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790096760.889922:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:8135:x1877052305190144:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 387us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096760.889930:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790096761.213135:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096761.213157:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096761.213244:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096761.213364:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096768 00000100:00100000:2.0:1790096761.213387:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096768 00000100:00100000:2.0:1790096761.213437:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790096761.213445:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096761.213473:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096761.213519:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096761.213526:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1790096761.213607:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff080380 x1877052324096768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096761.213623:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324096768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790096761.405142:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096762.430586:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096763.460540:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096763.772952:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096763.772977:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324096896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096763.773044:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096763.773111:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324096896 00000100:00100000:0.0:1790096763.773118:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324096896 00000100:00100000:0.0:1790096763.773179:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790096763.773198:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324096896:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790096763.773344:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790096763.780301:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096763.781576:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324096896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8381us (8523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096763.781595:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790096763.784089:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb823b80 x1877052324096896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096763.784119:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324096896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790096764.476902:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790096765.382432:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00000001:00100000:1.0:1790096765.397839:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00010000:00010000:2.0:1790096765.501539:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096765.820855:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324097280:0@lo:400:kworker.0 00000100:00100000:0.0:1790096765.820941:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096765.820996:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096765.821002:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324097408:0@lo:400:kworker.0 00000100:00100000:0.0:1790096765.821024:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096765.821060:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097280 00000100:00100000:0.0:1790096765.821067:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097280 00000100:00100000:0.0:1790096765.821112:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096765.821120:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324097280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096765.821163:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324097280:12345-0@lo:400:kworker.0 Request processed in 44us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096765.821182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096765.821204:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097408 00000100:00100000:0.0:1790096765.821207:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097408 00000100:00100000:0.0:1790096765.821229:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096765.821234:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096765.821261:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324097408:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096765.821266:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790096765.821317:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb820e00 x1877052324097408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096765.821330:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324097408:0@lo:400:kworker.0 00000100:00100000:0.0:1790096765.821341:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324097280:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822092:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324097152:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822132:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096765.822155:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324097664:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822171:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096765.822188:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790096765.822193:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324097024:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822213:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096765.822235:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324097536:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822251:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096765.822272:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097152 00000100:00100000:2.0:1790096765.822276:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097152 00000100:00100000:2.0:1790096765.822326:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097536 00000100:00100000:2.0:1790096765.822329:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097536 00000100:00100000:2.0:1790096765.822351:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790096765.822358:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324097152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822398:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324097152:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096765.822405:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790096765.822433:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790096765.822439:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324097536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822470:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324097536:12345-0@lo:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096765.822475:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790096765.822493:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097024 00000100:00100000:2.0:1790096765.822497:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097024 00000100:00100000:2.0:1790096765.822516:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790096765.822521:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822550:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324097024:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096765.822556:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790096765.822596:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324097024:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822607:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324097536:0@lo:400:kworker.0 00000100:00100000:2.0:1790096765.822616:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324097152:0@lo:400:kworker.0 00000100:00080000:1.0:1790096765.825056:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096765.825066:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096765.825082:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097664 00000100:00100000:1.0:1790096765.825092:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097664 00000100:00100000:1.0:1790096765.825147:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790096765.825156:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096765.825233:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324097664:12345-0@lo:400:kworker.0 Request processed in 78us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096765.825240:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790096765.825257:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790096765.826398:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb823800 x1877052324097664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096765.826415:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324097664:0@lo:400:kworker.0 00000001:00100000:0.0:1790096765.883265:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00000100:00100000:0.0:1790096766.124070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096766.124123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096766.124155:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096766.124183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096766.124243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096766.124286:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190784 00000100:00100000:0.0:1790096766.124310:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190784 00000100:00100000:0.0:1790096766.124390:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190656 00000100:00100000:0.0:1790096766.124396:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190656 00000100:00100000:0.0:1790096766.124434:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096766.124449:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096766.124568:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096766.124603:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096766.124687:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1790096766.124698:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096766.124732:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096766.124745:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1790096766.124771:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190528 00000100:00100000:0.0:1790096766.124778:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190528 00000100:00100000:0.0:1790096766.124824:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190400 00000100:00100000:0.0:1790096766.124831:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190400 00000100:00100000:0.0:1790096766.124868:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1790096766.124880:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096766.124923:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305190528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096766.124941:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1790096766.124960:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790096766.124976:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305190400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096766.125014:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305190400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096766.125023:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1790096766.126064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190272 00000100:00100000:2.0:1790096766.126076:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190272 00000100:00080000:1.0:1790096766.126109:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096766.126119:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096766.126122:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096766.126140:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:2.0:1790096766.126154:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305190272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096766.126326:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305190272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 176us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096766.126334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:0.0:1790096766.334254:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096766.334332:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096766.334603:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097792 00000100:00100000:3.0:1790096766.334611:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097792 00000100:00100000:3.0:1790096766.334672:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790096766.334681:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324097792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096766.334713:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096766.334812:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324097792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096766.334819:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1790096766.337946:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff082a00 x1877052324097792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096766.337991:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324097792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096766.525492:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096766.560287:0:10337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1790096767.552601:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096768.573847:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096768.899520:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324097920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096768.899586:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096768.899746:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324097920 00000100:00100000:3.0:1790096768.899754:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324097920 00000100:00100000:3.0:1790096768.899850:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790096768.899861:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324097920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096768.899899:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790096768.900022:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096768.900083:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324097920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096768.900091:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790096768.900336:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaeefd5f80 x1877052324097920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096768.900355:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324097920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790096769.596760:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096770.620848:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096770.941547:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324098304:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.941673:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096770.941689:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324098176:0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.941729:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096770.941745:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096770.941750:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324098688:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.941751:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324098432:0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.941774:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096770.941790:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098304 00000100:00100000:0.0:1790096770.941801:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098304 00000100:00100000:3.0:1790096770.941870:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790096770.941878:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324098048:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.941879:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098176 00000100:00100000:0.0:1790096770.941882:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098176 00000100:00100000:0.0:1790096770.941906:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790096770.941910:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096770.941915:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324098304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.941978:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324098304:12345-0@lo:400:kworker.0 Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096770.941986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790096770.942008:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790096770.942014:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324098176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.942048:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324098560:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.942051:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324098176:12345-0@lo:400:kworker.0 Request processed in 37us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096770.942057:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790096770.942070:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096770.942089:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098560 00000100:00100000:0.0:1790096770.942093:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098560 00000100:00100000:3.0:1790096770.942108:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324098176:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.942116:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790096770.942121:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.942141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098048 00000100:00100000:3.0:1790096770.942145:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098048 00000100:00100000:0.0:1790096770.942156:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324098560:12345-0@lo:400:kworker.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096770.942162:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790096770.942175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1790096770.942178:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098688 00000100:00100000:0.0:1790096770.942181:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098688 00000100:00100000:3.0:1790096770.942182:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324098048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.942209:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790096770.942212:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324098048:12345-0@lo:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096770.942215:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.942219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1790096770.942243:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324098688:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096770.942249:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790096770.942262:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096770.942280:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096770.942303:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096770.942336:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324098304:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.942362:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324098048:0@lo:400:kworker.0 00000100:00100000:0.0:1790096770.942371:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324098560:0@lo:400:kworker.0 00010000:00080000:0.0:1790096770.942381:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb823100 x1877052324098688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096770.942405:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324098688:0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.943726:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098432 00000100:00100000:3.0:1790096770.943745:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098432 00000100:00100000:3.0:1790096770.944517:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790096770.944530:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324098432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096770.944664:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324098432:12345-0@lo:400:kworker.0 Request processed in 107us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096770.944672:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790096770.945615:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790096770.945695:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb823480 x1877052324098432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096770.945713:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324098432:0@lo:400:kworker.0 00000100:00100000:1.0:1790096771.246035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096771.246191:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096771.246225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096771.246249:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096771.246292:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096771.246325:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191424 00000100:00100000:1.0:1790096771.246337:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191424 00000100:00100000:1.0:1790096771.246408:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191296 00000100:00100000:1.0:1790096771.246411:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191296 00000100:00100000:1.0:1790096771.246439:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790096771.246451:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096771.246557:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096771.246566:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790096771.246586:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790096771.246593:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096771.246620:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096771.246627:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790096771.246863:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191168 00000100:00100000:1.0:1790096771.246868:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191168 00000100:00100000:1.0:1790096771.246899:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191040 00000100:00100000:1.0:1790096771.246903:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191040 00000100:00100000:1.0:1790096771.246925:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1790096771.246932:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096771.246964:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096771.246970:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1790096771.246982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790096771.246988:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305191040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096771.247013:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305191040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096771.247019:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00080000:1.0:1790096771.247041:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096771.247047:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096771.247049:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096771.253900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305190912 00000100:00100000:3.0:1790096771.254192:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305190912 00000100:00100000:3.0:1790096771.255940:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:3.0:1790096771.255982:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305190912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096771.256115:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305190912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 144us (10099us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096771.256124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:1.0:1790096771.453490:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096771.453520:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324098816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096771.453613:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096771.453821:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098816 00000100:00100000:2.0:1790096771.453834:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098816 00000100:00100000:2.0:1790096771.453899:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790096771.453911:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324098816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096771.453960:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096771.454025:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324098816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096771.454035:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1790096771.454129:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff083800 x1877052324098816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096771.454150:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324098816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096771.645314:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096772.671279:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096773.692784:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096774.021727:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324098944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096774.021848:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096774.022114:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324098944 00000100:00100000:0.0:1790096774.022125:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324098944 00000100:00100000:0.0:1790096774.022195:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790096774.022212:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324098944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790096774.022279:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096774.022342:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324098944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096774.022350:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790096774.022854:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaeefd4000 x1877052324098944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096774.022942:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324098944:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790096774.023861:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790096774.721005:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096775.741011:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096776.061314:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324099200:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.061427:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096776.061507:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324099712:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.061536:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096776.061585:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790096776.061592:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324099072:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.061626:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096776.061705:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324099584:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.061730:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096776.061766:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099712 00000100:00100000:1.0:1790096776.061776:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099712 00000100:00100000:1.0:1790096776.061847:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790096776.061858:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.061918:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324099712:12345-0@lo:400:kworker.0 Request processed in 62us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.061925:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790096776.061954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099072 00000100:00100000:1.0:1790096776.061958:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099072 00000100:00100000:1.0:1790096776.061986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790096776.061994:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062025:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324099072:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.062052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790096776.062085:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099200 00000100:00100000:1.0:1790096776.062089:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099200 00000100:00100000:1.0:1790096776.062115:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099584 00000100:00100000:1.0:1790096776.062119:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099584 00000100:00100000:1.0:1790096776.062141:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790096776.062148:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062181:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324099200:12345-0@lo:400:kworker.0 Request processed in 34us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.062187:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790096776.062199:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790096776.062205:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062249:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324099584:12345-0@lo:400:kworker.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.062255:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790096776.062273:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096776.062279:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096776.062323:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324099072:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062338:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324099584:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062348:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324099200:0@lo:400:kworker.0 00010000:00080000:1.0:1790096776.062362:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e5c00 x1877052324099712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096776.062374:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324099712:0@lo:400:kworker.0 00000100:00100000:0.0:1790096776.062695:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324099328:0@lo:400:kworker.0 00000100:00100000:0.0:1790096776.062739:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096776.062787:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096776.062795:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324099456:0@lo:400:kworker.0 00000100:00100000:0.0:1790096776.062821:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096776.062874:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099456 00000100:00100000:1.0:1790096776.062887:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099456 00000100:00100000:1.0:1790096776.062933:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790096776.062941:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324099456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.062990:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324099456:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.063087:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790096776.063114:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790096776.063135:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e4380 x1877052324099456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096776.063146:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324099456:0@lo:400:kworker.0 00000100:00100000:2.0:1790096776.063192:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099328 00000100:00100000:2.0:1790096776.063198:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099328 00000100:00100000:2.0:1790096776.063246:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790096776.063254:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324099328:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790096776.063287:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096776.063304:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324099328:12345-0@lo:400:kworker.0 Request processed in 49us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096776.063311:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790096776.063318:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324099328:0@lo:400:kworker.0 00000100:00100000:1.0:1790096776.361890:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096776.361942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096776.361977:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096776.362014:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096776.362053:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191680 00000100:00100000:1.0:1790096776.362065:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191680 00000100:00100000:0.0:1790096776.362253:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191936 00000100:00100000:0.0:1790096776.362259:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191936 00000100:00100000:0.0:1790096776.362314:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1790096776.362327:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096776.362448:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 123us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096776.362457:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00080000:0.0:1790096776.362679:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790096776.362685:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096776.363032:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191808 00000100:00100000:2.0:1790096776.363050:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191808 00000100:00100000:2.0:1790096776.363125:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1790096776.363134:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096776.363191:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305191808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 58us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096776.363198:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:1.0:1790096776.363863:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:1.0:1790096776.363878:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305191680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096776.363941:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305191680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096776.363949:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00080000:0.0:1790096776.364242:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096776.365663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305191552 00000100:00100000:3.0:1790096776.365679:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305191552 00000100:00100000:3.0:1790096776.365745:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:3.0:1790096776.365755:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305191552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096776.365834:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305191552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (3855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096776.365842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:0.0:1790096776.381704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096776.381816:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192064 00000100:00100000:3.0:1790096776.381829:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192064 00000100:00100000:3.0:1790096776.381912:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:3.0:1790096776.381923:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305192064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096776.382022:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305192064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096776.382029:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00080000:3.0:1790096776.382189:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096776.572953:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096776.572987:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096776.573079:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096776.573212:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099840 00000100:00100000:0.0:1790096776.573231:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099840 00000100:00100000:0.0:1790096776.573303:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096776.573314:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324099840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096776.573359:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096776.573415:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324099840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096776.573422:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790096776.573467:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb821180 x1877052324099840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096776.573503:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324099840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790096776.764998:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096777.792315:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096778.813442:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096779.145738:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324099968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790096779.145889:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096779.148558:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324099968 00000100:00100000:2.0:1790096779.148580:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324099968 00000100:00100000:2.0:1790096779.148718:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790096779.148732:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324099968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096779.148817:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096779.148917:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324099968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096779.148925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790096779.151799:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790096779.157837:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e6a00 x1877052324099968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096779.157874:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324099968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096779.846938:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096780.861119:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096781.182770:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324100480:0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.182881:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096781.182954:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096781.182961:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324100352:0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.182991:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096781.183263:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100480 00000100:00100000:0.0:1790096781.183273:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100480 00000100:00100000:0.0:1790096781.183344:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096781.183355:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324100480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.183420:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324100480:12345-0@lo:400:kworker.0 Request processed in 66us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.183428:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096781.183459:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100352 00000100:00100000:0.0:1790096781.183463:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100352 00000100:00100000:0.0:1790096781.183496:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790096781.183504:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324100352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.183536:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324100352:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.183542:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790096781.183591:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324100352:0@lo:400:kworker.0 00010000:00080000:0.0:1790096781.183607:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb821500 x1877052324100480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096781.183921:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324100480:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.184353:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324100096:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.184414:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096781.184465:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324100608:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.184493:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096781.184555:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790096781.184563:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324100224:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.184588:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096781.184626:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100096 00000100:00100000:0.0:1790096781.184632:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100096 00000100:00100000:0.0:1790096781.184694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790096781.184702:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324100096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.184749:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324100096:12345-0@lo:400:kworker.0 Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.184756:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1790096781.186148:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096781.186158:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096781.186399:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324100736:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.186459:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096781.186499:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324100096:0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.186532:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100736 00000100:00100000:2.0:1790096781.186538:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100736 00000100:00100000:2.0:1790096781.186599:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790096781.186608:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324100736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096781.186682:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324100736:12345-0@lo:400:kworker.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096781.186690:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1790096781.186760:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb821880 x1877052324100736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096781.186774:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324100736:0@lo:400:kworker.0 00000100:00080000:0.0:1790096781.187806:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096781.188488:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100608 00000100:00100000:3.0:1790096781.188502:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100608 00000100:00100000:3.0:1790096781.188577:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100224 00000100:00100000:3.0:1790096781.188582:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100224 00000100:00100000:3.0:1790096781.188611:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790096781.188620:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096781.188741:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324100608:12345-0@lo:400:kworker.0 Request processed in 122us (4246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096781.188749:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790096781.188768:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790096781.188774:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324100224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096781.188806:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324100224:12345-0@lo:400:kworker.0 Request processed in 33us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096781.188813:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1790096781.188976:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096781.189472:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324100224:0@lo:400:kworker.0 00000100:00100000:3.0:1790096781.189488:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324100608:0@lo:400:kworker.0 00000100:00100000:0.0:1790096781.486894:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096781.486946:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096781.486993:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096781.487020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096781.487046:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096781.487087:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192448 00000100:00100000:0.0:1790096781.487100:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192448 00000100:00100000:0.0:1790096781.487175:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192320 00000100:00100000:0.0:1790096781.487179:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192320 00000100:00100000:0.0:1790096781.487221:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1790096781.487235:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305192448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096781.487249:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192576 00000100:00100000:2.0:1790096781.487257:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192576 00000100:00100000:2.0:1790096781.487294:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192704 00000100:00100000:2.0:1790096781.487298:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192704 00000100:00100000:0.0:1790096781.487334:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305192448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.487348:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1790096781.487370:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1790096781.487377:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305192320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096781.487395:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096781.487411:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2359:x1877052305192576:12345-192.168.203.11@tcp:9:kworker.0 00000100:00100000:0.0:1790096781.487433:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305192320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 56us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.487441:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000020:00000080:2.0:1790096781.487444:0:7012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5976 00000100:00080000:2.0:1790096781.487456:0:7012:0:(import.c:65:import_set_state_nolock()) ffff9eaaff325000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790096781.487471:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790096781.487480:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2359:x1877052305192704:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1790096781.487497:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab597d 00000001:00000004:2.0:1790096781.487504:0:7012:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1790096781.487504:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9eaaff216000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790096781.487544:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790096781.487725:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192192 00000100:00100000:1.0:1790096781.487730:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192192 00000100:00100000:1.0:1790096781.487765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:1.0:1790096781.487774:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305192192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096781.487807:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305192192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096781.487813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:2.0:1790096781.487970:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56fd0760-a5ee-4811-af5a-739a392b530e+2:2359:x1877052305192576:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 563us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096781.487978:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00010000:00010000:2.0:1790096781.488017:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096781.488552:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56fd0760-a5ee-4811-af5a-739a392b530e+2:2359:x1877052305192704:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 1071us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096781.488561:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:0.0:1790096781.488589:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096781.488594:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790096781.488598:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790096781.492313:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096781.702049:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096781.702072:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324100864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096781.702137:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096781.702181:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100864 00000100:00100000:3.0:1790096781.702199:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100864 00000100:00100000:3.0:1790096781.702326:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790096781.702336:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324100864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096781.702382:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096781.702426:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324100864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096781.702433:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790096781.703384:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb214a80 x1877052324100864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096781.703407:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324100864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096781.885023:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096782.911191:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096783.944203:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096784.254471:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096784.254495:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324100992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096784.254566:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096784.254897:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324100992 00000100:00100000:3.0:1790096784.254906:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324100992 00000100:00100000:3.0:1790096784.254969:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790096784.254978:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324100992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096784.255014:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096784.255063:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324100992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096784.255070:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1790096784.255143:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e6a00 x1877052324100992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096784.255161:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324100992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790096784.255232:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1790096784.257057:0:11039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790096784.957783:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790096785.866947:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00000020:00000080:0.0:1790096785.866956:0:7663:0:(genops.c:885:class_export_put()) final put ffff9eaaff212800/56fd0760-a5ee-4811-af5a-739a392b530e 00000020:00000080:2.0:1790096785.867054:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff212800/56fd0760-a5ee-4811-af5a-739a392b530e for lustre-OST0001 00000020:00000080:2.0:1790096785.867126:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff216000 for lustre-OST0001 00010000:00010000:3.0:1790096785.984625:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096786.303249:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324101248:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303319:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303369:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324101760:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303393:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303434:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790096786.303441:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324101120:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303479:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303502:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324101632:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303522:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303546:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324101376:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303565:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303582:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096786.303587:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324101504:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303605:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.303629:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101760 00000100:00100000:2.0:1790096786.303655:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101760 00000100:00100000:2.0:1790096786.303699:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101504 00000100:00100000:2.0:1790096786.303702:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101504 00000100:00100000:2.0:1790096786.303725:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790096786.303732:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324101760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303782:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324101760:12345-0@lo:400:kworker.0 Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.303789:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790096786.303806:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790096786.303813:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324101504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303844:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324101504:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.303850:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790096786.303866:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101120 00000100:00100000:2.0:1790096786.303869:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101120 00000100:00100000:2.0:1790096786.303891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790096786.303904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324101120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.303933:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324101120:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.303939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790096786.303966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101248 00000100:00100000:2.0:1790096786.303970:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101248 00000100:00100000:2.0:1790096786.303991:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101632 00000100:00100000:2.0:1790096786.303994:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101632 00000100:00100000:2.0:1790096786.304008:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101376 00000100:00100000:2.0:1790096786.304011:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101376 00000100:00100000:2.0:1790096786.304022:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790096786.304027:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324101248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304053:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324101248:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.304059:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790096786.304068:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790096786.304074:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304098:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324101632:12345-0@lo:400:kworker.0 Request processed in 24us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.304103:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790096786.304113:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790096786.304118:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324101376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304140:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324101376:12345-0@lo:400:kworker.0 Request processed in 22us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.304146:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1790096786.304206:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff081880 x1877052324101504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096786.304232:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324101504:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304246:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324101376:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304274:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324101120:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304283:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324101632:0@lo:400:kworker.0 00000100:00100000:2.0:1790096786.304292:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324101248:0@lo:400:kworker.0 00010000:00080000:2.0:1790096786.304301:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaff081180 x1877052324101760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096786.304309:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324101760:0@lo:400:kworker.0 00000100:00080000:1.0:1790096786.304598:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096786.304604:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096786.304606:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1790096786.341259:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00000020:00000080:3.0:1790096786.341269:0:6721:0:(genops.c:885:class_export_put()) final put ffff9eaaff326000/56fd0760-a5ee-4811-af5a-739a392b530e 00000020:00000080:1.0:1790096786.341345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff326000/56fd0760-a5ee-4811-af5a-739a392b530e for lustre-OST0000 00000020:00000080:1.0:1790096786.341403:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff325000 for lustre-OST0000 00000100:00100000:3.0:1790096786.608462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096786.608523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096786.608555:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096786.608589:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193088 00000100:00100000:3.0:1790096786.608599:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193088 00000100:00100000:3.0:1790096786.608681:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192960 00000100:00100000:3.0:1790096786.608684:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192960 00000100:00100000:3.0:1790096786.608712:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1790096786.608722:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305193088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096786.608794:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305193088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096786.608810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1790096786.608830:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:3.0:1790096786.608837:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305192960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096786.608864:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305192960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096786.608871:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00080000:3.0:1790096786.608891:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096786.609142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305192832 00000100:00100000:2.0:1790096786.609148:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305192832 00000100:00100000:2.0:1790096786.609194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:2.0:1790096786.609202:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305192832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096786.609239:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305192832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.609245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:3.0:1790096786.812837:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096786.812862:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324101888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096786.812930:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096786.813107:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324101888 00000100:00100000:2.0:1790096786.813116:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324101888 00000100:00100000:2.0:1790096786.813179:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790096786.813189:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324101888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096786.813223:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096786.813291:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324101888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096786.813319:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790096786.813756:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb214a80 x1877052324101888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096786.813789:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324101888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790096787.010028:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096788.034560:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790096788.411782:0:11189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc604f1490 20000000:00000080:2.0:1790096788.411807:0:11189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaaeefd3000 uarg=0000000000000000 20000000:01000000:2.0:1790096788.411863:0:11189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790096788.411872:0:11189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790096788.411878:0:11189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790096788.413932:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1790096788.415478:0:11189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790096788.425381:0:11189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790096788.425435:0:11189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425461:0:11189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425471:0:11189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425478:0:11189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425555:0:11189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425563:0:11189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425570:0:11189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425620:0:11189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425674:0:11189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 12 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.425719:0:11189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102016:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096788.425860:0:11189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.425869:0:11189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 12 pid: 5844 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.425890:0:11189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb215500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102144:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096788.426254:0:11189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.426263:0:11189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 18 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.426273:0:11189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb216300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102272:0@lo:104: 00000100:00100000:0.0:1790096788.426334:0:11189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790096788.426376:0:11189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.426385:0:11189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.426393:0:11189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb215f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102400:0@lo:104: 00000100:00100000:0.0:1790096788.428227:0:11189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096788.428323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102272 00000100:00100000:2.0:1790096788.428333:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102272 00010000:00010000:0.0:1790096788.428337:0:11189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.428354:0:11189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 18 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.428382:0:11189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb215180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102528:0@lo:104: 00000100:00100000:2.0:1790096788.428383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102400 00000100:00100000:2.0:1790096788.428386:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102400 00000100:00100000:2.0:1790096788.428401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790096788.428411:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11189:x1877052324102272:12345-0@lo:104: 00010000:00010000:2.0:1790096788.428430:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.428446:0:11189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096788.428458:0:11189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2c9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790096788.428496:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096788.428496:0:11189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb216300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102272:0@lo:104: 00000100:00100000:2.0:1790096788.428503:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11189:x1877052324102272:12345-0@lo:104: Request processed in 94us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096788.428511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790096788.428530:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102528 00000100:00100000:2.0:1790096788.428532:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102528 00000100:00100000:2.0:1790096788.428545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790096788.428551:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11189:x1877052324102400:12345-0@lo:104: 00010000:00010000:2.0:1790096788.428558:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096788.428603:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790096788.428616:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11189:x1877052324102400:12345-0@lo:104: Request processed in 64us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096788.428623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790096788.428654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790096788.428660:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:11189:x1877052324102528:12345-0@lo:104: 00010000:00010000:2.0:1790096788.428669:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096788.428704:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790096788.428709:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:11189:x1877052324102528:12345-0@lo:104: Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096788.428715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790096788.428831:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790096788.428842:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.428852:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096788.428859:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.428869:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096788.428877:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096788.428884:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790096788.428915:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790096788.428923:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.428925:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.428942:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096788.428945:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.428959:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096788.428972:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096788.428980:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.428989:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096788.429004:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096788.429006:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a400/0xcc97d9eae5ab5945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab594c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429026:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096788.429027:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429030:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.429040:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096788.429044:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096788.429050:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429058:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096788.429067:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.429067:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096788.429087:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790096788.429090:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b400/0xcc97d9eae5ab5937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab593e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429104:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.429110:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096788.429112:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096788.429113:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096788.429117:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096788.429122:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429130:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac8690400/0xcc97d9eae5ab5929 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5930 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429162:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096788.429164:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096788.429165:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096788.429174:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096788.429187:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324102656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096788.429234:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096788.429286:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102656 00000100:00100000:3.0:1790096788.429291:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102656 00010000:00010000:3.0:1790096788.429315:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096788.429346:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790096788.429355:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324102656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096788.429369:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096788.429376:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429386:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429403:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab594c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5945 expref: 19 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.429419:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096788.429460:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3315:x1877052324102656:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096788.429467:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790096788.429564:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324102656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096788.429798:0:11189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb215f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102400:0@lo:104: 00000100:00100000:0.0:1790096788.429808:0:11189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb215180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102528:0@lo:104: 00000100:00100000:1.0:1790096788.429906:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324102784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096788.429948:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096788.429989:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096788.429997:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324102912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096788.430031:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096788.430062:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102784 00000100:00100000:3.0:1790096788.430078:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102784 00000100:00100000:1.0:1790096788.430084:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1790096788.430102:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 18 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096788.430124:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324102912 00000100:00100000:3.0:1790096788.430127:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324102912 00010000:00010000:3.0:1790096788.430150:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 19 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096788.430162:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193216 00000100:00100000:3.0:1790096788.430165:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193216 00000100:00100000:1.0:1790096788.430186:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1790096788.430191:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 13 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096788.430204:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193344 00000100:00100000:3.0:1790096788.430207:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193344 00000100:00100000:1.0:1790096788.430217:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790096788.430242:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324102784:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096788.430246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790096788.430253:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790096788.430254:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324102912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096788.430258:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 19 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.430280:0:11189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb214a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102016:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096788.430283:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 19 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096788.430295:0:11189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb215500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11189:1877052324102144:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096788.430302:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ee00/0xcc97d9eae5ab593e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5937 expref: 19 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.430317:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096788.430328:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096788.430335:0:11189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096788.430336:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 18 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096788.430352:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3316:x1877052324102784:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (403us total) trans 0 rc 0/0 00010000:00010000:2.0:1790096788.430357:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 18 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096788.430359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790096788.430376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790096788.430382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+14:2362:x1877052305193216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096788.430391:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096788.430395:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 14 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.431103:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 14 pid: 5844 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096788.431147:0:8472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790096788.431156:0:8472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1790096788.431275:0:5837:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790096788.431289:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1790096788.431298:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+14:2362:x1877052305193344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096788.431311:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096788.431316:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 14 pid: 5844 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096788.433221:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab5930 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5929 expref: 17 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096788.433250:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096788.433401:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3316:x1877052324102912:12345-0@lo:103:ldlm_bl.0 Request processed in 3147us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096788.433433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790096788.434222:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 14 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.434247:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5968 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e6e expref: 14 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096788.434262:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096788.434329:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305193216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3947us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096788.434338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790096788.434407:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324102912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096788.434435:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324102784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096788.439186:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 12 pid: 5844 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439223:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690800/0xcc97d9eae5ab5953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e36 expref: 12 pid: 5844 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439265:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439275:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439299:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439307:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439315:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439323:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439331:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096788.439336:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.439345:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.444452:0:11189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096788.444476:0:11189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.453896:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.453924:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5984 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096788.453980:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096788.454084:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2362:x1877052305193344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 22781us (23892us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096788.454096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00010000:00010000:1.0:1790096789.056548:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096789.376502:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324103040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096789.376604:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096789.377887:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103040 00000100:00100000:1.0:1790096789.377904:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103040 00000100:00100000:1.0:1790096789.377995:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790096789.378008:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324103040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096789.378061:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096789.378999:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324103040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 988us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096789.379012:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1790096789.379126:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096789.379272:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e4380 x1877052324103040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096789.379301:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324103040:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1790096789.564770:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790096789.564786:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff322800 from 7 10000000:01000000:2.0:1790096789.564794:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790096789.564873:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.564889:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.564904:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096789.564941:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.565046:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.565117:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096789.565319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103168 00000100:00100000:1.0:1790096789.565330:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103168 00000100:00100000:1.0:1790096789.565392:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790096789.565406:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324103168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096789.565425:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096789.565443:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab598b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.565475:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.565489:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.565501:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a200, rc 0) 00000100:00100000:1.0:1790096789.565551:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096789.565579:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790096789.566836:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096789.566867:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.566880:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096789.567015:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.567073:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.567125:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790096789.567214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103296 00000100:00100000:0.0:1790096789.567223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103296 00000100:00100000:0.0:1790096789.567268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790096789.567277:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096789.567732:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096789.567742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790096789.568008:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.568051:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.568098:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.568145:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096789.568594:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103424 00000100:00100000:1.0:1790096789.568602:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103424 00000100:00100000:1.0:1790096789.568676:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790096789.568686:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096789.568906:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096789.568913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790096789.569620:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790096789.574074:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790096789.574406:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790096789.574437:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790096789.574451:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096789.574466:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096789.574480:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790096789.574484:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac4279800 from 7 10000000:01000000:3.0:1790096789.574486:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790096789.574540:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096789.574549:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096789.574563:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096789.574595:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790096789.574719:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096789.574767:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb3189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096789.575095:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103552 00000100:00100000:1.0:1790096789.575104:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103552 00000100:00100000:1.0:1790096789.575177:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790096789.575188:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324103552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096789.575207:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096789.575223:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5999 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.575252:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.575264:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096789.575273:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b400, rc 0) 00000100:00100000:1.0:1790096789.575332:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096789.575340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790096789.575698:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096789.575730:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096789.575741:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096789.575814:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096789.575850:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096789.575887:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb3189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096789.576015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103680 00000100:00100000:2.0:1790096789.576023:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103680 00000100:00100000:2.0:1790096789.576058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790096789.576067:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.576404:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096789.576412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790096789.577138:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096789.577199:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096789.577264:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096789.577306:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb3189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096789.577382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103808 00000100:00100000:1.0:1790096789.577390:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103808 00000100:00100000:1.0:1790096789.577447:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790096789.577456:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096789.577760:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096789.577767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790096789.578145:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790096789.583293:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790096789.583969:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790096789.584002:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790096789.584017:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.584032:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096789.584045:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790096789.584058:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac41f3800 from 7 10000000:01000000:2.0:1790096789.584061:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790096789.584109:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.584118:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.584141:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096789.584174:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.584266:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.584331:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096789.584880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324103936 00000100:00100000:0.0:1790096789.584891:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324103936 00000100:00100000:0.0:1790096789.584949:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790096789.584960:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324103936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096789.584979:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096789.585008:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab59a7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096789.585042:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096789.585054:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096789.585063:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690200, rc 0) 00000100:00100000:0.0:1790096789.585123:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324103936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096789.585139:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790096789.585289:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324103936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096789.585309:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096789.585320:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096789.585389:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324104064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.585430:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.585464:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096789.585518:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104064 00000100:00100000:0.0:1790096789.585522:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104064 00000100:00100000:0.0:1790096789.585555:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790096789.585563:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324104064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096789.585915:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324104064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096789.585923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790096789.586118:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324104064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.586167:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324104192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.586212:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096789.586247:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790096789.586267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104192 00000100:00100000:2.0:1790096789.586271:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104192 00000100:00100000:2.0:1790096789.586301:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790096789.586308:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324104192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096789.586478:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324104192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096789.586486:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790096789.586527:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff080700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324104192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790096789.589095:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790096789.590125:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790096789.590167:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790096789.590182:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096789.590196:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096790.080593:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096790.187285:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096790.187629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193472 00000100:00100000:2.0:1790096790.187680:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193472 00000100:00100000:2.0:1790096790.187749:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:2.0:1790096790.187878:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:5601:x1877052305193472:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096790.187901:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096790.187929:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e98 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096790.187973:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096790.187987:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096790.187998:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8800, rc 0) 00000100:00100000:2.0:1790096790.188081:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193472:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 321us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096790.188089:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:2.0:1790096790.193388:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096790.193512:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193600 00000100:00100000:1.0:1790096790.193528:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193600 00000100:00100000:1.0:1790096790.193609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:1.0:1790096790.193623:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193600:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096790.194081:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193600:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 459us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096790.194090:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:1.0:1790096790.201021:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096790.201508:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193728 00000100:00100000:0.0:1790096790.201523:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193728 00000100:00100000:0.0:1790096790.201605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:0.0:1790096790.201618:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193728:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096790.202199:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193728:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 579us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096790.202210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:2.0:1790096790.214358:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096790.214483:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193856 00000100:00100000:0.0:1790096790.214496:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193856 00000100:00100000:0.0:1790096790.214566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:0.0:1790096790.214579:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305193856:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096790.214603:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096790.214629:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820e9f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096790.214699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096790.214712:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096790.214723:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691600, rc 0) 00000100:00100000:0.0:1790096790.214799:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305193856:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 220us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096790.214807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:3.0:1790096790.232517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096790.234680:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305193984 00000100:00100000:0.0:1790096790.234699:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305193984 00000100:00100000:0.0:1790096790.234775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1790096790.234786:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305193984:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096790.235214:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305193984:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 428us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096790.235223:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:2.0:1790096790.244200:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096790.244327:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194112 00000100:00100000:1.0:1790096790.244346:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194112 00000100:00100000:1.0:1790096790.244426:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:1.0:1790096790.244439:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305194112:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096790.244818:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305194112:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 380us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096790.244828:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00010000:00010000:0.0:1790096791.102218:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096791.426974:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324104320:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427158:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427218:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324104832:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427265:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427298:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096791.427308:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324104704:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427342:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427379:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324104448:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427409:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427435:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324104960:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427455:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427473:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096791.427479:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324104576:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.427500:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096791.427535:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104320 00000100:00100000:1.0:1790096791.427543:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104320 00000100:00100000:1.0:1790096791.427591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790096791.427600:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096791.429981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104832 00000100:00100000:0.0:1790096791.430003:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104832 00000100:00100000:0.0:1790096791.430080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104448 00000100:00100000:0.0:1790096791.430085:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104448 00000100:00100000:0.0:1790096791.430106:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104576 00000100:00100000:0.0:1790096791.430109:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104576 00000100:00100000:0.0:1790096791.430142:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790096791.430154:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096791.430270:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324104832:12345-0@lo:400:kworker.0 Request processed in 118us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096791.430278:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790096791.430302:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790096791.430311:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096791.430346:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324104448:12345-0@lo:400:kworker.0 Request processed in 38us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096791.430352:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790096791.430366:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790096791.430373:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324104576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790096791.433959:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096791.434001:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104704 00000100:00100000:3.0:1790096791.434016:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104704 00000100:00100000:3.0:1790096791.434922:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324104960 00000100:00100000:3.0:1790096791.434934:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324104960 00000100:00100000:3.0:1790096791.434978:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790096791.434991:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096791.436238:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324104576:12345-0@lo:400:kworker.0 Request processed in 5854us (8725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096791.436256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790096791.441465:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324104320:12345-0@lo:400:kworker.0 Request processed in 13854us (14296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096791.441482:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790096791.441599:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096791.441630:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324104960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.441730:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324104960:12345-0@lo:400:kworker.0 Request processed in 122us (14273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096791.441736:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096791.444565:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324104576:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.446161:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324104448:0@lo:400:kworker.0 00010000:00080000:1.0:1790096791.447245:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e5880 x1877052324104960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096791.447260:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324104960:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.447312:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324104320:0@lo:400:kworker.0 00000100:00100000:1.0:1790096791.447326:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324104832:0@lo:400:kworker.0 00000100:00080000:2.0:1790096791.448608:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096791.448622:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096791.448898:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324104704:12345-0@lo:400:kworker.0 Request processed in 13903us (21549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096791.448914:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1790096791.449045:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e7480 x1877052324104704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096791.449062:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324104704:0@lo:400:kworker.0 00000100:00100000:2.0:1790096791.721868:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096791.721910:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194240 00000100:00100000:2.0:1790096791.721919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194240 00000100:00100000:2.0:1790096791.721970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:2.0:1790096791.721978:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305194240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096791.722046:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305194240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096791.722053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:2.0:1790096791.726048:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096791.726089:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096791.726127:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194368 00000100:00100000:2.0:1790096791.726136:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194368 00000100:00100000:2.0:1790096791.726199:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194496 00000100:00100000:2.0:1790096791.726202:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194496 00000100:00100000:2.0:1790096791.726226:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:2.0:1790096791.726235:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305194368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096791.726328:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305194368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096791.726336:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:2.0:1790096791.726357:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:2.0:1790096791.726368:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305194496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096791.726397:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305194496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096791.726402:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00080000:2.0:1790096791.726418:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096791.935709:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096791.935735:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324105088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096791.935810:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096791.942622:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105088 00000100:00100000:3.0:1790096791.942661:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105088 00000100:00100000:3.0:1790096791.942723:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790096791.942735:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324105088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096791.942778:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096791.942866:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324105088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (7056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096791.942873:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1790096791.942965:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e7480 x1877052324105088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096791.942998:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324105088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096792.127452:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096793.157192:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790096793.532317:0:11387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790096794.175370:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096794.493129:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096794.493154:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324105216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096794.493226:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096794.493485:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105216 00000100:00100000:3.0:1790096794.493498:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105216 00000100:00080000:0.0:1790096794.493593:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096794.493596:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790096794.493612:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324105216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096794.493674:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096794.493743:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324105216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096794.493749:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790096794.493945:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e5500 x1877052324105216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096794.493965:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324105216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096795.206971:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096796.221902:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096796.542354:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096796.542485:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324105472:0@lo:400:kworker.0 00000100:00100000:0.0:1790096796.542575:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096796.542629:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790096796.542665:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324105600:0@lo:400:kworker.0 00000100:00100000:0.0:1790096796.542687:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096796.542735:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105472 00000100:00100000:0.0:1790096796.542742:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105472 00000100:00100000:0.0:1790096796.542785:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105600 00000100:00100000:0.0:1790096796.542788:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105600 00000100:00100000:0.0:1790096796.542816:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790096796.542824:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096796.542895:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324105472:12345-0@lo:400:kworker.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096796.542902:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790096796.542919:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790096796.542924:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096796.542948:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324105600:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096796.542953:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1790096796.542973:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096796.543003:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324105600:0@lo:400:kworker.0 00000100:00100000:0.0:1790096796.543014:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324105472:0@lo:400:kworker.0 00000100:00100000:1.0:1790096796.543558:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096796.543571:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad03fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324105728:0@lo:400:kworker.0 00000100:00100000:1.0:1790096796.543609:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096796.543671:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105728 00000100:00100000:1.0:1790096796.543686:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105728 00000100:00100000:1.0:1790096796.543722:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790096796.543729:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324105728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096796.543767:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324105728:12345-0@lo:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096796.543773:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1790096796.543800:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad03fca80 x1877052324105728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096796.543811:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad03fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324105728:0@lo:400:kworker.0 00000100:00080000:0.0:1790096796.544494:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096796.546349:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324105344:0@lo:400:kworker.0 00000100:00100000:3.0:1790096796.546412:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096796.546615:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096796.546625:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad03fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324105984:0@lo:400:kworker.0 00000100:00100000:2.0:1790096796.546671:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096796.546699:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105984 00000100:00100000:2.0:1790096796.546706:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105984 00000100:00100000:2.0:1790096796.546755:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790096796.546762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324105984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096796.546804:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324105984:12345-0@lo:400:kworker.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096796.546811:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790096796.546858:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad03fd500 x1877052324105984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096796.546873:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad03fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324105984:0@lo:400:kworker.0 00000100:00080000:2.0:1790096796.546890:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096796.546950:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096796.546972:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad03fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324105856:0@lo:400:kworker.0 00000100:00100000:3.0:1790096796.547000:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096796.547919:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105856 00000100:00100000:2.0:1790096796.547928:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105856 00000100:00100000:2.0:1790096796.548152:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790096796.548161:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324105856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096796.548383:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324105856:12345-0@lo:400:kworker.0 Request processed in 223us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096796.548390:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1790096796.548614:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096796.548672:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad03fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324105856:0@lo:400:kworker.0 00000100:00100000:1.0:1790096796.554617:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324105344 00000100:00100000:1.0:1790096796.554631:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324105344 00000100:00100000:1.0:1790096796.554751:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790096796.554761:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096796.554870:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324105344:12345-0@lo:400:kworker.0 Request processed in 111us (8457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096796.554877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790096796.554976:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324105344:0@lo:400:kworker.0 00000100:00100000:2.0:1790096796.843536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096796.843685:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194624 00000100:00100000:1.0:1790096796.843696:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194624 00000100:00100000:2.0:1790096796.843762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1790096796.843774:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305194624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096796.843858:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305194624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096796.843866:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1790096796.850035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096796.850075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096796.850111:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194752 00000100:00100000:2.0:1790096796.850119:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194752 00000100:00100000:2.0:1790096796.850173:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305194880 00000100:00100000:2.0:1790096796.850176:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305194880 00000100:00100000:2.0:1790096796.850196:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:2.0:1790096796.850205:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305194752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096796.850275:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305194752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096796.850282:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:2.0:1790096796.850299:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1790096796.850304:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305194880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096796.850325:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305194880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096796.850342:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00080000:2.0:1790096796.850361:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096797.058171:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790096797.061499:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324106112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096797.061582:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096797.061879:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106112 00000100:00100000:3.0:1790096797.061900:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106112 00000100:00100000:3.0:1790096797.061962:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790096797.061972:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324106112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096797.062013:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096797.062094:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324106112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096797.062101:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790096797.062247:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e5880 x1877052324106112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096797.062283:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324106112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790096797.248782:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790096797.472038:0:11487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:06:35 (1790096795) === 00000100:00100000:0.0:1790096797.827765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096797.827821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096797.827929:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195136 00000100:00100000:3.0:1790096797.827939:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195136 00000100:00100000:3.0:1790096797.828000:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790096797.828011:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9688:x1877052305195136:12345-192.168.203.11@tcp:700:mkdir.0 00000100:00100000:3.0:1790096797.828118:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9688:x1877052305195136:12345-192.168.203.11@tcp:700:mkdir.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096797.828126:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790096797.828260:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195008 00000100:00100000:2.0:1790096797.828265:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195008 00000100:00100000:2.0:1790096797.828301:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096797.828309:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305195008:12345-192.168.203.11@tcp:41:mkdir.0 00000004:00000024:2.0:1790096797.828335:0:8484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790096797.828395:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305195008:12345-192.168.203.11@tcp:41:mkdir.0 Request processed in 87us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096797.828402:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096797.835579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096797.841342:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195392 00000100:00100000:1.0:1790096797.841358:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195392 00000100:00100000:1.0:1790096797.843255:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790096797.843290:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9688:x1877052305195392:12345-192.168.203.11@tcp:36:mkdir.0 00010000:00010000:1.0:1790096797.843349:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096797.843381:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab58a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e21 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.843421:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:1.0:1790096797.843433:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096797.843941:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.843956:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.843965:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.845894:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.845920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.845933:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096797.848175:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790096797.848262:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848273:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848282:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848289:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096797.848300:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848308:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848324:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096797.848327:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096797.848332:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.848339:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096797.848357:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027c8c2e0 reply state 00000000be8305ba transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096797.848367:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790096797.848700:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9688:x1877052305195392:12345-192.168.203.11@tcp:36:mkdir.0 Request processed in 5423us (13125us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790096797.848710:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:3.0:1790096797.859121:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859140:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859148:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859168:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17ac00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096797.859172:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859181:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859207:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eaac4db7800) 00010000:00010000:3.0:1790096797.859211:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096797.859216:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.859223:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab59ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096797.865881:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096797.866078:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195520 00000100:00100000:1.0:1790096797.866089:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195520 00000100:00100000:1.0:1790096797.866146:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790096797.866156:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9689:x1877052305195520:12345-192.168.203.11@tcp:101:chmod.0 00010000:00010000:1.0:1790096797.866176:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096797.866308:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ea6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866379:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866405:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866417:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096797.866451:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790096797.866455:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096797.866506:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866534:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ea6 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866553:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ea6 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.866562:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096797.866565:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096797.866569:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a800, rc 0) 00000100:00100000:1.0:1790096797.866837:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9689:x1877052305195520:12345-192.168.203.11@tcp:101:chmod.0 Request processed in 681us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096797.866846:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790096797.878846:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096797.879798:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195776 00000100:00100000:3.0:1790096797.879811:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195776 00000100:00100000:3.0:1790096797.879884:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790096797.879894:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9689:x1877052305195776:12345-192.168.203.11@tcp:36:chmod.0 00010000:00010000:3.0:1790096797.879949:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096797.879977:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab59d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ea6 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.879996:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:3.0:1790096797.880007:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096797.880035:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.880049:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.880084:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096797.880511:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3edf9cc reply state 000000005f876848 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096797.880521:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790096797.880530:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790096797.880630:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:9689:x1877052305195776:12345-192.168.203.11@tcp:36:chmod.0 Request processed in 733us (1789us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790096797.880716:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00010000:00010000:3.0:1790096797.884362:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884380:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884389:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884397:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096797.884402:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884410:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884426:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096797.884429:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790096797.884435:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.884454:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab59df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096797.915714:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096797.915927:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305195904 00000100:00100000:1.0:1790096797.915949:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305195904 00000100:00100000:1.0:1790096797.916007:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096797.916018:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9690:x1877052305195904:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1790096797.916042:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096797.916087:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ead expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916157:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916171:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916181:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096797.916225:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790096797.916229:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096797.916261:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ead expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916300:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ead expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.916308:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7300) 00010000:00010000:1.0:1790096797.916310:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096797.916314:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17aa00, rc 0) 00000100:00100000:1.0:1790096797.916372:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:9690:x1877052305195904:12345-192.168.203.11@tcp:101:chown.0 Request processed in 356us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096797.916379:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1790096797.924858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096797.925067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305196032 00000100:00100000:1.0:1790096797.925100:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305196032 00000100:00100000:1.0:1790096797.925167:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790096797.925177:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:9690:x1877052305196032:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1790096797.925208:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096797.925232:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820eb4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925298:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925312:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925323:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925340:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925347:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925354:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925454:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925463:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925470:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096797.925508:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790096797.925511:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096797.925530:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925542:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925548:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925555:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925561:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096797.925565:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925573:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925585:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7300) 00010000:00010000:1.0:1790096797.925588:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096797.925592:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925598:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab59fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925623:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925629:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925667:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096797.925671:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925677:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925684:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eaac4db7b00) 00010000:00010000:1.0:1790096797.925686:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096797.925689:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925694:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5a02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925724:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab59f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eb4 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925736:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eb4 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096797.925743:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac4db7e00) 00010000:00010000:1.0:1790096797.925745:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096797.925754:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17ac00, rc 0) 00000100:00100000:1.0:1790096797.925822:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+9:9690:x1877052305196032:12345-192.168.203.11@tcp:101:chown.0 Request processed in 646us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096797.925829:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790096797.934082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096797.934200:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305196288 00000100:00100000:3.0:1790096797.934211:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305196288 00000100:00100000:3.0:1790096797.934271:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790096797.934281:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+9:9690:x1877052305196288:12345-192.168.203.11@tcp:36:chown.0 00010000:00010000:3.0:1790096797.934337:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096797.934364:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eb4 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.934386:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac4db7e00) 00010000:00010000:3.0:1790096797.934397:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096797.934422:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.934436:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096797.934446:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096798.018913:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1790096798.018928:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1790096798.019159:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eddc362 reply state 00000000ef12fd90 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096798.019174:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790096798.019247:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1790096798.019344:0:7513:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790096798.019362:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9690:x1877052305196288:12345-192.168.203.11@tcp:36:chown.0 Request processed in 85078us (85292us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790096798.019371:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00010000:00010000:3.0:1790096798.022003:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022020:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022027:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022053:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.022058:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022066:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022097:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096798.022100:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790096798.022106:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.022113:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096798.034787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096798.035150:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305196416 00000100:00100000:2.0:1790096798.035162:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305196416 00000100:00100000:2.0:1790096798.035233:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790096798.035242:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9691:x1877052305196416:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:2.0:1790096798.035264:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096798.035287:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ebb expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790096798.035560:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1790096798.041668:0:8484:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6334us 00010000:00010000:3.0:1790096798.056714:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.056737:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.056751:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.056769:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.056777:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.056796:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057167:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057177:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057184:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096798.057205:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096798.057209:0:8484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096798.057244:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057255:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057262:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057269:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057277:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.057281:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057289:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057307:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7300) 00010000:00010000:3.0:1790096798.057310:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.057315:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057322:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057335:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057341:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057347:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057353:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.057355:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057361:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057368:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096798.057370:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.057373:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057379:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057428:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ebb expref: 8 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057444:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ebb expref: 7 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.057760:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.057762:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790096798.057765:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f600, rc 0) 00000100:00100000:3.0:1790096798.057848:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9691:x1877052305196416:12345-192.168.203.11@tcp:101:touch.500 Request processed in 22605us (23067us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096798.057858:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790096798.063852:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.063939:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305196672 00000100:00100000:3.0:1790096798.063950:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305196672 00000100:00100000:3.0:1790096798.064010:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790096798.064020:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9691:x1877052305196672:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:3.0:1790096798.064211:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096798.064232:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ec2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064594:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064609:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064619:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064860:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064869:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.064934:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790096798.065732:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1790096798.066110:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066124:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066133:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066166:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066173:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066179:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066185:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.066189:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066207:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066219:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.066222:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.066227:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066233:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096798.066246:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007949f03f reply state 0000000062fc754f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096798.066255:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790096798.066286:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec2 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066297:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec2 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.066301:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3cb00) 00010000:00010000:3.0:1790096798.066303:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096798.066305:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f200, rc 0) 00000100:00100000:3.0:1790096798.066371:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+10:9691:x1877052305196672:12345-192.168.203.11@tcp:101:touch.500 Request processed in 2352us (3336us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790096798.066381:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:3.0:1790096798.070830:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070860:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070868:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070886:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.070891:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070900:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070916:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096798.070919:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.070924:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.070930:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5a41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096798.071270:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096798.071348:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305196928 00000100:00100000:0.0:1790096798.071361:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305196928 00000100:00100000:0.0:1790096798.071531:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1790096798.071543:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+9:9691:x1877052305196928:12345-192.168.203.11@tcp:36:touch.500 00010000:00010000:0.0:1790096798.071604:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096798.071624:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec2 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096798.071670:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3cb00) 00010000:00010000:0.0:1790096798.071679:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096798.071733:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096798.071746:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096798.071757:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096798.071897:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d4e8406 reply state 000000003bb2def2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096798.071906:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096798.071995:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+10:9691:x1877052305196928:12345-192.168.203.11@tcp:36:touch.500 Request processed in 454us (729us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790096798.072002:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00010000:00010000:3.0:1790096798.073510:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073524:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073531:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073538:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.073554:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073562:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073574:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:3.0:1790096798.073576:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.073580:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.073585:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690800/0xcc97d9eae5ab5a56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096798.074338:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.074411:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197056 00000100:00100000:3.0:1790096798.074421:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197056 00000100:00100000:3.0:1790096798.074474:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1790096798.074484:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+9:9691:x1877052305197056:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:3.0:1790096798.074506:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096798.074522:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ec9 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.074576:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec9 expref: 10 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.074621:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec9 expref: 10 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.074692:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096798.074696:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096798.074710:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fc00, rc 0) 00000100:00100000:3.0:1790096798.074760:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+10:9691:x1877052305197056:12345-192.168.203.11@tcp:101:touch.500 Request processed in 277us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096798.074767:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1790096798.078871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096798.079037:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197184 00000100:00100000:2.0:1790096798.079059:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197184 00000100:00100000:2.0:1790096798.079118:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790096798.079125:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1877052305197184:12345-192.168.203.11@tcp:8:touch.500 00010000:00080000:2.0:1790096798.079157:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1790096798.079187:0:6694:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab5a64 00002000:00100000:2.0:1790096798.079199:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7428525e-2b7d-490f-8a81-8b717b826fb3/ffff9eaafb3c5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790096798.079220:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790096798.079434:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790096798.079465:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9eaafb3c0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096798.079534:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305197184:12345-192.168.203.11@tcp:8:touch.500 Request processed in 408us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096798.079542:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790096798.085353:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096798.085460:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197312 00000100:00100000:0.0:1790096798.085470:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197312 00000100:00100000:0.0:1790096798.085544:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790096798.085554:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:0:x1877052305197312:12345-192.168.203.11@tcp:2:touch.500 00000100:00080000:3.0:1790096798.085884:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096798.130315:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:0:x1877052305197312:12345-192.168.203.11@tcp:2:touch.500 Request processed in 44751us (44960us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790096798.130328:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000001:00080000:1.0:1790096798.131215:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1790096798.131230:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000100:00100000:3.0:1790096798.135173:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096798.135276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197568 00000100:00100000:0.0:1790096798.135294:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197568 00000100:00100000:0.0:1790096798.135361:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790096798.135372:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+10:9691:x1877052305197568:12345-192.168.203.11@tcp:35:touch.500 00000100:00100000:0.0:1790096798.135996:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+11:9691:x1877052305197568:12345-192.168.203.11@tcp:35:touch.500 Request processed in 624us (830us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790096798.136005:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790096798.157726:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.157877:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197696 00000100:00100000:3.0:1790096798.157888:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197696 00000100:00100000:3.0:1790096798.157957:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790096798.157967:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+11:9692:x1877052305197696:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1790096798.157991:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096798.158013:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ed0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158086:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158101:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158112:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096798.158146:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096798.158150:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096798.158192:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158218:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5a6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ed0 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158258:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ed0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.158267:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.158270:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096798.158274:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ee00, rc 0) 00000100:00100000:3.0:1790096798.158338:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+12:9692:x1877052305197696:12345-192.168.203.11@tcp:101:rm.0 Request processed in 371us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096798.158345:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790096798.162830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096798.163112:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305197952 00000100:00100000:0.0:1790096798.163135:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305197952 00000100:00100000:0.0:1790096798.163193:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790096798.163202:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+12:9692:x1877052305197952:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1790096798.163222:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096798.163241:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab5a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ed7 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096798.163394:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790096798.164126:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab5a79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ed7 expref: 14 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.164142:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7300) 00010000:00010000:1.0:1790096798.164145:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790096798.164150:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab5a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ed7 expref: 14 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.164163:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691a00, rc 0) 00000100:00100000:1.0:1790096798.164227:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+13:9692:x1877052305197952:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1025us (1406us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1790096798.164235:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1790096798.179571:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.179743:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305198080 00000100:00100000:3.0:1790096798.179754:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305198080 00000100:00100000:3.0:1790096798.179821:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790096798.179832:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+13:9692:x1877052305198080:12345-192.168.203.11@tcp:37:rm.0 00000100:00100000:2.0:1790096798.196760:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+13:9692:x1877052305198080:12345-192.168.203.11@tcp:37:rm.0 Request processed in 16918us (17187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096798.196774:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790096798.208376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096798.208557:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305198336 00000100:00100000:0.0:1790096798.208569:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305198336 00000100:00100000:0.0:1790096798.208856:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790096798.208868:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+13:9692:x1877052305198336:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:0.0:1790096798.209325:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:9692:x1877052305198336:12345-192.168.203.11@tcp:35:rm.0 Request processed in 457us (957us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790096798.209335:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790096798.219380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096798.219561:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305198592 00000100:00100000:2.0:1790096798.219573:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305198592 00000100:00100000:2.0:1790096798.219673:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1790096798.219684:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:9692:x1877052305198592:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1790096798.219709:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096798.219744:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ede expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.219838:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5a8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.219852:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.219862:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096798.219873:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790096798.220056:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ede expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.220086:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5a8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ede expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.220094:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:2.0:1790096798.220097:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790096798.220100:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096798.220157:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305198592:12345-192.168.203.11@tcp:101:rm.0 Request processed in 475us (797us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790096798.220165:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790096798.229988:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096798.230185:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305198720 00000100:00100000:1.0:1790096798.230197:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305198720 00000100:00100000:1.0:1790096798.230257:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790096798.230268:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305198720:12345-192.168.203.11@tcp:41:rm.0 00000004:00000024:1.0:1790096798.230332:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790096798.230452:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305198720:12345-192.168.203.11@tcp:41:rm.0 Request processed in 185us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096798.230459:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1790096798.236724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096798.236829:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305198848 00000100:00100000:1.0:1790096798.236840:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305198848 00000100:00100000:1.0:1790096798.236913:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1790096798.236924:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305198848:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1790096798.236955:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096798.236976:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ee5 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237036:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237052:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237064:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237090:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237097:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237103:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237206:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237232:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237240:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096798.237268:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790096798.237272:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096798.237288:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237301:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237309:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237315:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237321:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237327:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096798.237332:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237340:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237353:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:1.0:1790096798.237356:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096798.237368:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237375:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237390:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237397:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237403:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237407:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096798.237410:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237415:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237423:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9eaac4db7b00) 00010000:00010000:1.0:1790096798.237425:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096798.237428:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237433:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237463:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ee5 expref: 18 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237490:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ee5 expref: 17 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.237496:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:1.0:1790096798.237499:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096798.237501:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a400, rc 0) 00000100:00100000:1.0:1790096798.237702:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+17:9692:x1877052305198848:12345-192.168.203.11@tcp:101:rm.0 Request processed in 779us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096798.237710:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790096798.243605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.244122:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305199104 00000100:00100000:3.0:1790096798.244132:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305199104 00000100:00100000:3.0:1790096798.244197:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1790096798.244208:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+17:9692:x1877052305199104:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1790096798.244262:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790096798.244289:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ee5 expref: 17 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244311:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ec9 expref: 16 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244336:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096798.244351:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5a72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ed0 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244360:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.244363:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096798.244395:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244408:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244418:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244432:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244440:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244446:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244738:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244748:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.244769:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790096798.246273:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1790096798.246290:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327816654164ns, next at 328816650052ns, rc = 0 00010000:00010000:3.0:1790096798.246364:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246620:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246631:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246745:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246751:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246758:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246819:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096798.246842:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246850:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246857:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246875:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.246879:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246898:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246910:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3c500) 00010000:00010000:3.0:1790096798.246913:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790096798.246917:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246924:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab5ac6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246954:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246962:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246968:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246973:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.246976:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.246982:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.247002:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.247005:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.247008:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.247014:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab5ab8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096798.247024:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a00ddd1d reply state 00000000f1cbb9d4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096798.247033:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096798.247144:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305199104:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2934us (3544us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790096798.247153:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00010000:00010000:1.0:1790096798.252221:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096798.252235:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.252246:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ea00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096798.252250:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.252260:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.252278:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eaac2c3c500) 00010000:00010000:1.0:1790096798.252281:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790096798.252286:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096798.252293:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab5acd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096798.252697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096798.252959:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305199360 00000100:00100000:1.0:1790096798.252983:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305199360 00000100:00100000:1.0:1790096798.253036:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790096798.253046:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305199360:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:1.0:1790096798.253281:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+17:9692:x1877052305199360:12345-192.168.203.11@tcp:35:rm.0 Request processed in 235us (587us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790096798.253289:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00010000:00010000:2.0:1790096798.254106:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254118:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254136:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254142:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096798.254146:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254155:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254170:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096798.254173:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096798.254179:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096798.254185:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab5abf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096798.256855:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096798.257044:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305199616 00000100:00100000:3.0:1790096798.257055:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305199616 00000100:00100000:3.0:1790096798.257125:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790096798.257134:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+16:9692:x1877052305199616:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1790096798.257192:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790096798.257217:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ede expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257239:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab5a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ebb expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257251:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c800) 00010000:00010000:3.0:1790096798.257283:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab59ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ead expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257293:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7300) 00010000:00010000:3.0:1790096798.257298:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096798.257320:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257333:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257343:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257354:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257360:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257367:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257627:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257688:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.257696:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096798.258253:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790096798.258276:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258284:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258290:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258295:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.258299:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258307:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258316:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096798.258319:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790096798.258323:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258328:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab5ae2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258350:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258356:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258361:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258366:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.258375:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258381:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258388:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3ca00) 00010000:00010000:3.0:1790096798.258391:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.258394:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.258400:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab5ad4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096798.258413:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d24e25da reply state 000000008c0e06fc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096798.258422:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096798.258507:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:9692:x1877052305199616:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1372us (1659us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790096798.258515:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00010000:00010000:0.0:1790096798.259312:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096798.259317:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096798.259320:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096798.261551:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261568:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261576:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261583:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fc00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096798.261587:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261607:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261622:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096798.261625:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096798.261629:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096798.261809:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab5adb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096798.272469:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096799.295541:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790096799.613841:0:7000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329184203197ns, next at 330184200390ns, rc = 0 00000100:00100000:0.0:1790096799.613919:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324106240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096799.614004:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096799.614095:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106240 00000100:00100000:3.0:1790096799.614103:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106240 00000100:00100000:3.0:1790096799.614172:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790096799.614182:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324106240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096799.614218:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790096799.614228:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096799.614279:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324106240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096799.614286:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1790096799.614417:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafb3e6a00 x1877052324106240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096799.614433:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324106240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096800.317211:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096801.341270:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096801.661267:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096801.661292:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324106752:0@lo:400:kworker.0 00000100:00100000:1.0:1790096801.661292:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324106624:0@lo:400:kworker.0 00000100:00100000:3.0:1790096801.661361:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096801.661372:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324106496:0@lo:400:kworker.0 00000100:00100000:3.0:1790096801.661431:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324106368:0@lo:400:kworker.0 00000100:00100000:3.0:1790096801.661472:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096801.661481:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096801.661503:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790096801.661527:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324106880:0@lo:400:kworker.0 00000100:00100000:2.0:1790096801.661550:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324107008:0@lo:400:kworker.0 00000100:00100000:3.0:1790096801.661560:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096801.661598:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096801.661695:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106496 00000100:00100000:0.0:1790096801.661705:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106496 00000100:00100000:2.0:1790096801.661708:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106880 00000100:00100000:2.0:1790096801.661719:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106880 00000100:00100000:0.0:1790096801.661762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790096801.661776:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324106496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096801.661796:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790096801.661810:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324106880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096801.661849:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324106496:12345-0@lo:400:kworker.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096801.661861:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790096801.661888:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324106880:12345-0@lo:400:kworker.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096801.661906:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106368 00000100:00100000:0.0:1790096801.661915:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106368 00000100:00100000:0.0:1790096801.661945:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790096801.661951:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324106368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096801.661988:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324106368:12345-0@lo:400:kworker.0 Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096801.661994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1790096801.662027:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096801.662070:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324106496:0@lo:400:kworker.0 00000100:00100000:2.0:1790096801.662162:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790096801.662240:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096801.662319:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106624 00000100:00100000:2.0:1790096801.662326:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106624 00000100:00100000:2.0:1790096801.662364:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790096801.662372:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324106624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096801.662421:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324106624:12345-0@lo:400:kworker.0 Request processed in 50us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096801.662428:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790096801.662784:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324106880:0@lo:400:kworker.0 00000100:00100000:2.0:1790096801.662804:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324106368:0@lo:400:kworker.0 00000100:00080000:2.0:1790096801.662847:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096801.663348:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324106752 00000100:00100000:3.0:1790096801.663357:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324106752 00000100:00100000:1.0:1790096801.663370:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107008 00000100:00100000:1.0:1790096801.663375:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107008 00000100:00100000:1.0:1790096801.663418:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790096801.663427:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324107008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096801.663482:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324107008:12345-0@lo:400:kworker.0 Request processed in 57us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096801.663489:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1790096801.663732:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafbca3b80 x1877052324107008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096801.663746:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324107008:0@lo:400:kworker.0 00000100:00100000:1.0:1790096801.664227:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790096801.664237:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324106752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096801.664286:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324106752:12345-0@lo:400:kworker.0 Request processed in 53us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096801.664373:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324106624:0@lo:400:kworker.0 00010000:00080000:0.0:1790096801.664407:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafbca3480 x1877052324106752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096801.664426:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1790096801.664437:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096801.664441:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096801.664856:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324106752:0@lo:400:kworker.0 00000100:00100000:1.0:1790096801.965910:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096801.965958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096801.965993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096801.966052:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200000 00000100:00100000:1.0:1790096801.966056:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096801.966072:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200000 00000100:00100000:2.0:1790096801.966078:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305199872 00000100:00100000:2.0:1790096801.966083:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305199872 00000100:00100000:1.0:1790096801.966085:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200128 00000100:00100000:1.0:1790096801.966091:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200128 00000100:00100000:3.0:1790096801.966145:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305199744 00000100:00100000:3.0:1790096801.966150:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305199744 00000100:00100000:2.0:1790096801.966162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:2.0:1790096801.966173:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2363:x1877052305199872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096801.966233:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790096801.966241:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305200000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096801.966248:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2363:x1877052305199872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096801.966255:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:0.0:1790096801.966266:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305200000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096801.966272:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790096801.966306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1790096801.966317:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305199744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096801.966353:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305199744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096801.966359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00080000:0.0:1790096801.966417:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096801.966422:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096801.968599:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1790096801.968612:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305200128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096801.968719:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305200128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096801.968726:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:2.0:1790096802.173173:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096802.174572:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324107136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096802.174653:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096802.175248:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107136 00000100:00100000:3.0:1790096802.175256:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107136 00000100:00100000:3.0:1790096802.175318:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790096802.175327:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324107136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096802.175360:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096802.175407:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324107136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096802.175414:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1790096802.175451:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafbca3b80 x1877052324107136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096802.175469:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324107136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096802.366453:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790096802.496451:0:11635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1790096803.280683:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1790096803.280705:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1790096803.280719:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790096803.280737:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1790096803.280741:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790096803.280991:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad03fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324107264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790096803.281070:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096803.281223:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107264 00000100:00100000:2.0:1790096803.281232:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107264 00000100:00100000:2.0:1790096803.281295:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790096803.281305:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324107264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790096803.281348:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790096803.281386:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6ab2b59d, atime: 0x6ab2b59d, ctime: 0x6ab2b59d, blocks: 0x1 00010000:00010000:2.0:1790096803.281395:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.281411:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1790096803.281416:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096803.281422:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.281441:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.281451:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.281458:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.281476:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1790096803.282080:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790096803.282687:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096803.282696:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.282721:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096803.282726:0:7651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.282735:0:7651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.282758:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.282766:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab5ae9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.282789:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096803.282791:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096803.282793:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096803.283414:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324107264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2107us (2340us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790096803.283424:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1790096803.283726:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaad03fed80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1790096803.283734:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad03fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324107264:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790096803.390210:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790096803.708247:0:11685:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf31299e0 20000000:00000080:0.0:1790096803.708266:0:11685:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaafb837800 uarg=0000000000000000 20000000:01000000:0.0:1790096803.708307:0:11685:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790096803.708314:0:11685:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790096803.708320:0:11685:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790096803.711081:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790096803.711262:0:11685:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790096803.730221:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790096803.730281:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790096803.730340:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790096803.730358:0:11685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790096803.730377:0:11685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730397:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730405:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730411:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730419:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730426:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730447:0:11685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730488:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.730505:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 12 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.730521:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107392:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096803.731487:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.731501:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.731512:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107520:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096803.731549:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.731558:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 18 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.731567:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107648:0@lo:104: 00000100:00100000:1.0:1790096803.731601:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096803.731701:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.731724:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 18 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.731732:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107776:0@lo:104: 00000100:00100000:1.0:1790096803.731752:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096803.731780:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.731787:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 18 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.731795:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107904:0@lo:104: 00000100:00100000:1.0:1790096803.731813:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096803.731821:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096803.732417:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790096803.732433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107648 00000100:00100000:3.0:1790096803.732440:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107648 00000100:00100000:3.0:1790096803.732480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107776 00000100:00100000:3.0:1790096803.732482:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107776 00000100:00100000:3.0:1790096803.732492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324107904 00000100:00100000:3.0:1790096803.732494:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324107904 00000100:00100000:3.0:1790096803.732507:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790096803.732514:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:11685:x1877052324107648:12345-0@lo:104: 00010000:00010000:3.0:1790096803.732538:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.732615:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790096803.732622:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+5:11685:x1877052324107648:12345-0@lo:104: Request processed in 109us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.732630:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790096803.732670:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096803.732677:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11685:x1877052324107776:12345-0@lo:104: 00010000:00010000:3.0:1790096803.732684:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.732718:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790096803.732724:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+4:11685:x1877052324107776:12345-0@lo:104: Request processed in 48us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.732730:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096803.732741:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790096803.732746:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb66a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:11685:x1877052324107904:12345-0@lo:104: 00010000:00010000:3.0:1790096803.732754:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.732784:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790096803.732789:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb66a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+3:11685:x1877052324107904:12345-0@lo:104: Request processed in 44us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.732795:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1790096803.732831:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790096803.732836:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.732853:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096803.732858:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.732867:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096803.732875:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096803.732880:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096803.733091:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733098:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096803.733119:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733126:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaae8db9400/0xcc97d9eae5ab59a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733139:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096803.733141:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733147:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096803.733150:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733167:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096803.733173:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096803.733178:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096803.733191:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733198:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096803.733212:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733219:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab5999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab59a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733228:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096803.733231:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733236:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096803.733239:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733245:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096803.733251:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096803.733263:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790096803.733277:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733283:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096803.733289:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaae8db8400/0xcc97d9eae5ab598b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab5992 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.733309:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096803.733311:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096803.733312:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096803.733319:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096803.733337:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324108032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096803.733368:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096803.733402:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324108160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096803.733420:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096803.733434:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096803.733438:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324108288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096803.733455:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096803.733479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108032 00000100:00100000:3.0:1790096803.733483:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108032 00010000:00010000:3.0:1790096803.733500:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 19 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096803.733517:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108160 00000100:00100000:2.0:1790096803.733651:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108288 00000100:00100000:2.0:1790096803.733656:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108288 00010000:00010000:2.0:1790096803.733670:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 20 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096803.733699:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790096803.733705:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3315:x1877052324108032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790096803.733716:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096803.733722:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 20 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.733732:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 20 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.733746:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096803.733774:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3315:x1877052324108032:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096803.733780:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790096803.733792:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790096803.733797:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324108288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790096803.733804:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096803.733807:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 19 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.733815:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 19 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096803.733823:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096803.733842:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324108288:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096803.733848:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790096803.733876:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324108288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096803.734050:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096803.734243:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690200/0xcc97d9eae5ab59ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab59a7 expref: 18 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.734255:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107648:0@lo:104: 00000100:00100000:1.0:1790096803.734263:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107776:0@lo:104: 00010000:00010000:1.0:1790096803.734271:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab598b expref: 17 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.734278:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107904:0@lo:104: 00000100:00100000:3.0:1790096803.734329:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108160 00010000:00010000:3.0:1790096803.734345:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 17 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096803.734374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790096803.734380:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:3316:x1877052324108160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096803.734386:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096803.734390:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 17 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.734399:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 17 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.734409:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17b400/0xcc97d9eae5ab59a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab5999 expref: 17 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.734418:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096803.734452:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:3316:x1877052324108160:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.734458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790096803.734510:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324108032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096803.734733:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324108160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096803.738972:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096803.739040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200256 00000100:00100000:3.0:1790096803.739051:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200256 00000100:00100000:2.0:1790096803.739057:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1790096803.739092:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 13 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096803.739129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200384 00000100:00100000:3.0:1790096803.739132:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200384 00010000:00010000:3.0:1790096803.739144:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 14 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096803.739184:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790096803.739194:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+14:2363:x1877052305200256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096803.739209:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096803.739214:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 14 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739226:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 14 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739246:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096803.739297:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+14:2363:x1877052305200256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.739304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790096803.739322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:3.0:1790096803.739329:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305200384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096803.739338:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096803.739343:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 13 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.739354:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8691600/0xcc97d9eae5ab59bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e9f expref: 13 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739355:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 13 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739379:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739391:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.739398:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107392:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096803.739419:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db8800/0xcc97d9eae5ab59b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e98 expref: 12 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739421:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739436:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739442:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096803.739446:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1877052324107520:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096803.739449:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739458:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096803.739462:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739472:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.739480:0:11685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739483:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.739501:0:11685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096803.739502:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096803.739511:0:11685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096803.739518:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17b800/0xcc97d9eae5ab5af0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096803.739529:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2363:x1877052305200384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096803.739537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00010000:00010000:0.0:1790096804.412943:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096804.732941:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324108416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096804.733034:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096804.733447:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108416 00000100:00100000:3.0:1790096804.733456:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108416 00000100:00100000:3.0:1790096804.733518:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790096804.733529:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324108416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096804.733583:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096804.733882:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324108416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 354us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096804.733890:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790096804.734278:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324108416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790096805.436984:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096805.488409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096805.488519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200512 00000100:00100000:2.0:1790096805.488530:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200512 00000100:00100000:2.0:1790096805.488587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:2.0:1790096805.488597:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:5601:x1877052305200512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096805.488613:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096805.488659:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db9200/0xcc97d9eae5ab5af7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.488689:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db9200/0xcc97d9eae5ab5af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eec expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.488700:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db9200/0xcc97d9eae5ab5af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eec expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.488709:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9200, rc 0) 00000100:00100000:2.0:1790096805.488773:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305200512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 178us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.488780:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:3.0:1790096805.490498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096805.490587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200640 00000100:00100000:0.0:1790096805.490609:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200640 00000100:00100000:0.0:1790096805.490691:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1790096805.490701:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305200640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.490996:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305200640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 296us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.491005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1790096805.500145:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096805.501224:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200768 00000100:00100000:3.0:1790096805.501237:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200768 00000100:00100000:3.0:1790096805.501299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1790096805.501309:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305200768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096805.501609:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305200768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 301us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096805.501618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:1.0:1790096805.514470:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096805.516425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305200896 00000100:00100000:2.0:1790096805.516440:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305200896 00000100:00100000:2.0:1790096805.516510:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:2.0:1790096805.516520:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:9963:x1877052305200896:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096805.517080:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:9963:x1877052305200896:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 560us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.517089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:1.0:1790096805.528182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096805.528578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201024 00000100:00100000:3.0:1790096805.528588:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201024 00000100:00100000:3.0:1790096805.528673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:3.0:1790096805.528683:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:9963:x1877052305201024:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790096805.528943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:9963:x1877052305201024:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 262us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096805.528951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:0.0:1790096805.532632:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096805.532976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201152 00000100:00100000:2.0:1790096805.532987:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201152 00000100:00100000:2.0:1790096805.533053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:2.0:1790096805.533063:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:5601:x1877052305201152:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096805.533078:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096805.533095:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab5afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ef3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.533122:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab5afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ef3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.533133:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab5afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ef3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.533143:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9800, rc 0) 00000100:00100000:2.0:1790096805.533195:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305201152:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 134us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.533201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:2.0:1790096805.537738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096805.537845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201280 00000100:00100000:0.0:1790096805.537854:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201280 00000100:00100000:0.0:1790096805.537919:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:0.0:1790096805.537929:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305201280:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.538243:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305201280:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 315us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.538252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:1.0:1790096805.546168:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096805.546501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201408 00000100:00100000:3.0:1790096805.546511:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201408 00000100:00100000:3.0:1790096805.546569:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1790096805.546579:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305201408:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096805.546841:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:5601:x1877052305201408:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 263us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096805.546857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:1.0:1790096805.554155:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096805.554593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201536 00000100:00100000:2.0:1790096805.554603:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201536 00000100:00100000:2.0:1790096805.554767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:2.0:1790096805.554779:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:9966:x1877052305201536:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096805.555580:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:9966:x1877052305201536:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 801us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.555590:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:2.0:1790096805.560549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096805.560699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201664 00000100:00100000:0.0:1790096805.560710:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201664 00000100:00100000:0.0:1790096805.560765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:0.0:1790096805.560775:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:9966:x1877052305201664:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790096805.561552:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:9966:x1877052305201664:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 775us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.561562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 258 10000000:01000000:3.0:1790096805.692767:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790096805.692775:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff322800 from 7 10000000:01000000:3.0:1790096805.692781:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790096805.692832:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096805.692843:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096805.692854:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096805.692881:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb215880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790096805.692949:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096805.693078:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096805.693925:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108544 00000100:00100000:2.0:1790096805.693936:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108544 00000100:00100000:2.0:1790096805.693999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790096805.694009:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+16:5849:x1877052324108544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096805.694033:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096805.694052:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8c00/0xcc97d9eae5ab5b0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5b05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.694082:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8c00/0xcc97d9eae5ab5b0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b05 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.694092:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8c00/0xcc97d9eae5ab5b0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b05 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096805.694100:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8c00, rc 0) 00000100:00100000:2.0:1790096805.694248:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324108544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.694255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790096805.694586:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb215880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096805.694603:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.694629:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096805.694722:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.694754:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.694796:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096805.694855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108672 00000100:00100000:2.0:1790096805.694860:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108672 00000100:00100000:2.0:1790096805.694894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790096805.694902:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324108672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.695246:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324108672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.695356:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790096805.696171:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.696613:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.696731:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096805.696797:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790096805.696840:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108800 00000100:00100000:3.0:1790096805.696846:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108800 00000100:00100000:3.0:1790096805.696934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790096805.696942:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324108800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096805.697847:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324108800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 902us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096805.697856:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790096805.698006:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324108800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096805.698526:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11699:1877052324108928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096805.698573:0:11699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096805.698677:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096805.698769:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324108928 00000100:00100000:2.0:1790096805.698776:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324108928 00000100:00100000:2.0:1790096805.698850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790096805.698859:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:11699:x1877052324108928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096805.699055:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:11699:x1877052324108928:12345-0@lo:502:llog_process_th.0 Request processed in 197us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.699062:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790096805.699123:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11699:1877052324108928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790096805.699143:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096805.699150:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096805.699152:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790096805.699159:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eaaff322800 00000020:00000080:1.0:1790096805.699161:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790096805.699231:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11699:1877052324109056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096805.699264:0:11699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.709010:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109056 00000100:00100000:0.0:1790096805.709035:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109056 00000100:00100000:0.0:1790096805.709102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790096805.709113:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:11699:x1877052324109056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096805.709151:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de180 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.709391:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:11699:x1877052324109056:12345-0@lo:502:llog_process_th.0 Request processed in 279us (10125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.709399:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790096805.709471:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11699:1877052324109056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790096805.709507:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096805.709514:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096805.709517:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790096805.709523:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790096805.712082:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790096805.712115:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096805.712127:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.712141:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096805.712152:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790096805.712154:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac4279800 from 7 10000000:01000000:1.0:1790096805.712157:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096805.712196:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.712204:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.712215:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096805.712240:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096805.712467:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096805.712507:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.712573:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109184 00000100:00100000:0.0:1790096805.712581:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109184 00000100:00100000:0.0:1790096805.712629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790096805.712659:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:5849:x1877052324109184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096805.712672:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096805.712684:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5b13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.712716:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b13 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.712726:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b13 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.712734:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690e00, rc 0) 00000100:00100000:0.0:1790096805.712779:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.712786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790096805.712948:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096805.712964:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.712972:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096805.713034:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096805.713060:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096805.713109:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109312 00000100:00100000:2.0:1790096805.713115:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109312 00000100:00100000:1.0:1790096805.713124:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096805.716410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790096805.716430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.716733:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (3670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096805.716741:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790096805.718320:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.718384:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096805.718447:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096805.718737:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096805.722113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109440 00000100:00100000:1.0:1790096805.722128:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109440 00000040:00080000:3.0:1790096805.726762:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790096805.727797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790096805.727825:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096805.728067:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (9619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096805.728075:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790096805.728187:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096805.732753:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11703:1877052324109568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096805.732988:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096805.733046:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.733133:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109568 00000100:00100000:0.0:1790096805.733142:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109568 00000100:00100000:0.0:1790096805.733193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790096805.733203:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:11703:x1877052324109568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096805.733546:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:11703:x1877052324109568:12345-0@lo:502:llog_process_th.0 Request processed in 345us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.733554:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790096805.733915:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11703:1877052324109568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790096805.733947:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096805.733956:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096805.733958:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790096805.733965:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eaac4279800 00000020:00000080:3.0:1790096805.733968:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790096805.734056:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11703:1877052324109696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096805.734167:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096805.734228:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096805.745180:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109696 00000100:00100000:1.0:1790096805.745194:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109696 00000100:00100000:1.0:1790096805.745246:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790096805.745256:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:11703:x1877052324109696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096805.745511:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:11703:x1877052324109696:12345-0@lo:502:llog_process_th.0 Request processed in 255us (11343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096805.745519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790096805.745598:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11703:1877052324109696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790096805.745632:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096805.745661:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096805.745663:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790096805.745668:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790096805.745949:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790096805.745968:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096805.745978:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.745989:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096805.745999:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790096805.746002:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac41f3800 from 7 10000000:01000000:0.0:1790096805.746022:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790096805.746050:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.746058:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.746067:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096805.746087:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.746122:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.746161:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096805.746204:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109824 00000100:00100000:1.0:1790096805.746209:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109824 00000100:00100000:1.0:1790096805.746241:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790096805.746248:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:5849:x1877052324109824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096805.746257:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096805.746268:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab5b21 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.746288:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b21 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.746298:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b21 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096805.746308:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a200, rc 0) 00000100:00100000:1.0:1790096805.746336:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324109824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096805.746342:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790096805.746753:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096805.746767:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.746777:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096805.746833:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.746858:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.746880:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318780 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.746891:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324109952 00000100:00100000:0.0:1790096805.746894:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324109952 00000100:00100000:0.0:1790096805.746924:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790096805.746930:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324109952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.747140:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324109952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.747152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790096805.747181:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324109952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.747206:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324110080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.747240:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.747251:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318780 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.747262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110080 00000100:00100000:0.0:1790096805.747265:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110080 00000100:00100000:0.0:1790096805.747280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790096805.747284:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324110080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.747401:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:5849:x1877052324110080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.747408:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790096805.747439:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:5849:1877052324110080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096805.747613:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11706:1877052324110208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096805.747673:0:11706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096805.747691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110208 00000100:00100000:0.0:1790096805.747695:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110208 00000100:00100000:0.0:1790096805.747710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790096805.747715:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:11706:x1877052324110208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096805.747817:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:11706:x1877052324110208:12345-0@lo:502:llog_process_th.0 Request processed in 101us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096805.747824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790096805.747854:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790096805.747864:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11706:1877052324110208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790096805.747885:0:11706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096805.747892:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096805.747895:0:11706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790096805.747903:0:11706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eaac41f3800 00000020:00000080:0.0:1790096805.747905:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790096805.748874:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11706:1877052324110336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096805.748920:0:11706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096805.748943:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaef5de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096805.749059:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110336 00000100:00100000:3.0:1790096805.749065:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110336 00000100:00100000:3.0:1790096805.749105:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1790096805.749114:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:11706:x1877052324110336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096805.749275:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:11706:x1877052324110336:12345-0@lo:502:llog_process_th.0 Request processed in 163us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096805.749282:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790096805.749427:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:11706:1877052324110336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790096805.749451:0:11706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096805.749461:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096805.749463:0:11706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790096805.749468:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790096805.750842:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790096805.750870:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096805.750882:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096805.750893:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096806.462160:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096806.781467:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324110720:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781546:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096806.781611:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790096806.781618:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324110592:0@lo:400:kworker.0 00000100:00100000:3.0:1790096806.781622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324110848:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781654:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096806.781665:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096806.781671:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324111104:0@lo:400:kworker.0 00000100:00100000:3.0:1790096806.781689:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790096806.781690:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096806.781694:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324110464:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781717:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110720 00000100:00100000:1.0:1790096806.781725:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110720 00000100:00100000:3.0:1790096806.781732:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096806.781753:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324110976:0@lo:400:kworker.0 00000100:00100000:3.0:1790096806.781773:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096806.781773:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110592 00000100:00100000:1.0:1790096806.781776:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110592 00000100:00100000:1.0:1790096806.781793:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110976 00000100:00100000:1.0:1790096806.781796:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110976 00000100:00100000:1.0:1790096806.781811:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790096806.781818:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324110720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781866:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324110720:12345-0@lo:400:kworker.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.781872:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790096806.781886:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790096806.781891:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324110592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781913:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324110592:12345-0@lo:400:kworker.0 Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.781918:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790096806.781928:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790096806.781933:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324110976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.781987:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324110976:12345-0@lo:400:kworker.0 Request processed in 53us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.781993:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790096806.782028:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110848 00000100:00100000:1.0:1790096806.782032:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110848 00000100:00100000:1.0:1790096806.782057:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111104 00000100:00100000:1.0:1790096806.782060:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111104 00000100:00100000:1.0:1790096806.782077:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790096806.782083:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324110848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782114:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324110848:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.782119:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790096806.782129:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790096806.782135:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324111104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782158:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324111104:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.782164:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1790096806.782179:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096806.782183:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096806.782185:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096806.782217:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324110976:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782228:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324110848:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782258:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324110592:0@lo:400:kworker.0 00010000:00080000:1.0:1790096806.782270:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185a680 x1877052324111104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096806.782292:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324111104:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782305:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324110720:0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324110464 00000100:00100000:1.0:1790096806.782328:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324110464 00000100:00100000:1.0:1790096806.782354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790096806.782359:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324110464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096806.782391:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324110464:12345-0@lo:400:kworker.0 Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096806.782396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790096806.782420:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324110464:0@lo:400:kworker.0 00000040:00080000:3.0:1790096806.784474:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790096807.081204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096807.081254:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096807.081290:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096807.081341:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202048 00000100:00100000:0.0:1790096807.081353:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202048 00000100:00100000:2.0:1790096807.081390:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201792 00000100:00100000:2.0:1790096807.081397:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201792 00000100:00100000:2.0:1790096807.081438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:0.0:1790096807.081440:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790096807.081452:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305201792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096807.081455:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305202048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096807.081546:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305201792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 96us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096807.081573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:0.0:1790096807.081810:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305202048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 359us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096807.081817:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00080000:1.0:1790096807.089521:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096807.099753:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096807.103128:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202176 00000100:00100000:1.0:1790096807.103128:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305201920 00000100:00100000:1.0:1790096807.103143:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305201920 00000100:00100000:2.0:1790096807.103144:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202176 00000100:00100000:1.0:1790096807.103238:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1790096807.103247:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:2.0:1790096807.103258:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305202176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096807.103264:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305201920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096807.103461:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305201920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 213us (22169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096807.103470:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00080000:0.0:1790096807.103865:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096807.104053:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305202176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 795us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096807.104060:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1790096807.294519:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096807.294542:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096807.294610:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096807.294854:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111232 00000100:00100000:0.0:1790096807.294862:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111232 00000100:00100000:0.0:1790096807.294910:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096807.294919:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324111232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096807.294955:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096807.295026:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324111232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096807.295050:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1790096807.295185:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaafbca1180 x1877052324111232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096807.295204:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324111232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096807.485707:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790096808.366156:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1790096808.508940:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096809.532917:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096809.854313:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324111360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096809.854475:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096809.854748:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111360 00000100:00100000:3.0:1790096809.854759:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111360 00000100:00100000:3.0:1790096809.854828:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790096809.854842:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324111360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096809.854887:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096809.854940:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324111360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096809.854947:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790096809.855186:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1790096809.855192:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaad03fed80, transno 4294967300 00000100:00080000:1.0:1790096809.856148:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096809.856206:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324111360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790096810.558827:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096811.582190:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096811.900866:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096811.901152:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324111616:0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.901222:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096811.901276:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096811.901282:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324111744:0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.901304:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096811.901357:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111616 00000100:00100000:2.0:1790096811.901365:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111616 00000100:00100000:2.0:1790096811.901406:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111744 00000100:00100000:2.0:1790096811.901409:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111744 00000100:00100000:2.0:1790096811.901441:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790096811.901449:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324111616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.901498:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324111616:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096811.901506:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790096811.901523:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790096811.901529:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324111744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.901554:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324111744:12345-0@lo:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096811.901574:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790096811.901608:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324111744:0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.901617:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324111616:0@lo:400:kworker.0 00000100:00080000:2.0:1790096811.901674:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096811.903235:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096811.903260:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324111872:0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.903319:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096811.903490:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111872 00000100:00100000:2.0:1790096811.903498:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111872 00000100:00100000:2.0:1790096811.903551:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790096811.903559:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324111872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096811.903608:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324111872:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096811.903615:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1790096811.903654:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096811.903683:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324111872:0@lo:400:kworker.0 00000100:00100000:0.0:1790096811.906178:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324111488:0@lo:400:kworker.0 00000100:00100000:0.0:1790096811.906269:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096811.906489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324111488 00000100:00100000:3.0:1790096811.906497:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324111488 00000100:00100000:3.0:1790096811.906555:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790096811.906564:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324111488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096811.906629:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324111488:12345-0@lo:400:kworker.0 Request processed in 66us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096811.906653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790096811.906744:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324111488:0@lo:400:kworker.0 00000100:00100000:0.0:1790096811.907171:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096811.907181:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324112000:0@lo:400:kworker.0 00000100:00100000:0.0:1790096811.907213:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096811.907286:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324112128:0@lo:400:kworker.0 00000100:00100000:3.0:1790096811.907331:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096811.907450:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112000 00000100:00100000:1.0:1790096811.907462:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112000 00000100:00100000:1.0:1790096811.907516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790096811.907524:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324112000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096811.907562:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324112000:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096811.907569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790096811.907629:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112128 00000100:00100000:0.0:1790096811.907660:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112128 00000100:00100000:0.0:1790096811.907688:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096811.907695:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324112128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096811.907731:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324112128:12345-0@lo:400:kworker.0 Request processed in 37us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096811.907737:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096811.907767:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324112000:0@lo:400:kworker.0 00000100:00080000:2.0:1790096811.908225:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096811.908230:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790096811.908304:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185bb80 x1877052324112128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096811.908316:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324112128:0@lo:400:kworker.0 00000100:00100000:0.0:1790096812.204448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096812.204517:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096812.204553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096812.204590:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096812.204620:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202432 00000100:00100000:0.0:1790096812.204629:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202432 00000100:00100000:0.0:1790096812.204712:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202688 00000100:00100000:0.0:1790096812.204716:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202688 00000100:00100000:0.0:1790096812.204740:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:0.0:1790096812.204750:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305202432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096812.204823:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305202432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096812.204830:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:0.0:1790096812.204847:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:0.0:1790096812.204853:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305202688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096812.204877:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305202688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096812.204883:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:1.0:1790096812.205019:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202560 00000100:00100000:1.0:1790096812.205024:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202560 00000100:00100000:1.0:1790096812.205071:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1790096812.205079:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305202560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096812.205107:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305202560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096812.205114:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790096812.205738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202304 00000100:00100000:2.0:1790096812.205747:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202304 00000100:00100000:2.0:1790096812.205785:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:2.0:1790096812.205794:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305202304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096812.205836:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305202304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096812.205843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00080000:2.0:1790096812.205881:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096812.205886:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096812.413656:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096812.413680:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324112256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096812.413752:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096812.413982:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112256 00000100:00100000:0.0:1790096812.413991:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112256 00000100:00100000:0.0:1790096812.414149:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790096812.414161:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324112256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096812.414205:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096812.414270:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324112256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096812.414278:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790096812.414353:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad1859f80 x1877052324112256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096812.414375:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324112256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096812.605988:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096813.629414:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096814.655536:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096814.973140:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096814.973163:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324112384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096814.973231:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096814.973348:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112384 00000100:00100000:3.0:1790096814.973356:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112384 00000100:00100000:3.0:1790096814.973424:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790096814.973434:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324112384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096814.973467:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096814.973514:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324112384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096814.973522:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790096814.973563:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324112384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790096814.973797:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790096815.677022:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096816.702831:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096817.020853:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324112640:0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.020914:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096817.020971:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324113152:0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.020991:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096817.021013:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096817.021018:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324112768:0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.021033:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096817.021071:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112640 00000100:00100000:1.0:1790096817.021078:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112640 00000100:00100000:1.0:1790096817.021126:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112768 00000100:00100000:1.0:1790096817.021128:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112768 00000100:00100000:1.0:1790096817.021152:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790096817.021159:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324112640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.021215:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324112640:12345-0@lo:400:kworker.0 Request processed in 55us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096817.021222:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790096817.021236:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790096817.021241:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324112768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.021262:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324112768:12345-0@lo:400:kworker.0 Request processed in 21us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096817.021268:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000040:00080000:3.0:1790096817.021300:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790096817.021301:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324112768:0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.021310:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324112640:0@lo:400:kworker.0 00000100:00080000:2.0:1790096817.021651:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096817.021665:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324112512:0@lo:400:kworker.0 00000100:00100000:2.0:1790096817.021710:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096817.021731:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324113024:0@lo:400:kworker.0 00000100:00100000:2.0:1790096817.021752:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096817.021777:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096817.021782:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324112896:0@lo:400:kworker.0 00000100:00100000:2.0:1790096817.021802:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096817.021830:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113152 00000100:00100000:2.0:1790096817.021835:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113152 00000100:00100000:2.0:1790096817.021869:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112896 00000100:00100000:2.0:1790096817.021872:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112896 00000100:00100000:2.0:1790096817.021892:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790096817.021898:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324113152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096817.021948:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324113152:12345-0@lo:400:kworker.0 Request processed in 50us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096817.021954:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790096817.021966:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790096817.021976:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324112896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096817.022005:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113024 00000100:00100000:2.0:1790096817.022005:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324112896:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096817.022009:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113024 00000100:00100000:2.0:1790096817.022022:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790096817.022033:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1790096817.022039:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096817.022040:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324113024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790096817.022042:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096817.022044:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096817.022073:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324113024:12345-0@lo:400:kworker.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096817.022079:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1790096817.022127:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad185b100 x1877052324113152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096817.022137:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324113152:0@lo:400:kworker.0 00000100:00100000:3.0:1790096817.022160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324112896:0@lo:400:kworker.0 00000100:00100000:3.0:1790096817.022168:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324113024:0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.022789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324112512 00000100:00100000:1.0:1790096817.022795:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324112512 00000100:00100000:1.0:1790096817.022838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1790096817.022846:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324112512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096817.022905:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324112512:12345-0@lo:400:kworker.0 Request processed in 60us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096817.022911:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790096817.023045:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324112512:0@lo:400:kworker.0 00000100:00100000:0.0:1790096817.321581:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096817.321623:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096817.321702:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096817.321789:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202944 00000100:00100000:1.0:1790096817.321799:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202944 00000100:00100000:1.0:1790096817.321871:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203200 00000100:00100000:1.0:1790096817.321875:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203200 00000100:00100000:1.0:1790096817.321902:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:1.0:1790096817.321913:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305202944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096817.322002:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305202944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096817.322010:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:1.0:1790096817.322029:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790096817.322036:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305203200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096817.322062:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305203200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096817.322069:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1790096817.322478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305202816 00000100:00100000:2.0:1790096817.322483:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305202816 00000100:00100000:2.0:1790096817.322524:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:2.0:1790096817.322533:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305202816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096817.322575:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305202816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096817.322583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00080000:2.0:1790096817.322610:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096817.322815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096817.322946:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203072 00000100:00100000:2.0:1790096817.322952:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203072 00000100:00100000:2.0:1790096817.323001:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1790096817.323009:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096817.323053:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096817.323060:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:0.0:1790096817.323472:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096817.532958:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096817.532996:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324113280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096817.533090:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096817.533431:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113280 00000100:00100000:0.0:1790096817.533441:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113280 00000100:00100000:0.0:1790096817.533511:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790096817.533521:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324113280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096817.533561:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096817.533616:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324113280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096817.533624:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790096817.533824:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6e680 x1877052324113280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096817.533843:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324113280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096817.724968:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096818.749099:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096819.772867:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096820.093895:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaae8d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324113408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096820.093982:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096820.094095:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113408 00000100:00100000:1.0:1790096820.094104:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113408 00000100:00100000:1.0:1790096820.094161:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790096820.094181:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324113408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096820.094214:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790096820.094302:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096820.100162:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324113408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5983us (6169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096820.100188:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790096820.116711:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaae8d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324113408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096820.796823:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096821.823818:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096822.141052:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324113792:0@lo:400:kworker.0 00000100:00100000:3.0:1790096822.141083:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324113664:0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.141148:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324113920:0@lo:400:kworker.0 00000100:00100000:0.0:1790096822.141532:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324113536:0@lo:400:kworker.0 00000100:00100000:3.0:1790096822.144449:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096822.144509:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096822.144522:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324114176:0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.144567:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113664 00000100:00100000:3.0:1790096822.144570:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096822.144574:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113664 00000100:00100000:1.0:1790096822.144617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790096822.144626:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.144698:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324113664:12345-0@lo:400:kworker.0 Request processed in 73us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.144705:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790096822.144723:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324113664:0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.144756:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113920 00000100:00100000:1.0:1790096822.144760:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113920 00000100:00100000:1.0:1790096822.144794:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114176 00000100:00100000:1.0:1790096822.144797:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114176 00000100:00100000:1.0:1790096822.144816:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790096822.144823:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.144857:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324113920:12345-0@lo:400:kworker.0 Request processed in 36us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.144863:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790096822.144873:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790096822.144879:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.144927:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324114176:12345-0@lo:400:kworker.0 Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.144932:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1790096822.144963:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096822.144966:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096822.144989:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324113920:0@lo:400:kworker.0 00000100:00100000:2.0:1790096822.145348:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096822.145386:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113792 00000100:00100000:2.0:1790096822.145390:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113792 00000100:00100000:2.0:1790096822.145504:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790096822.145512:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324113792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096822.145559:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324113792:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096822.145565:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1790096822.145581:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096822.145599:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324113792:0@lo:400:kworker.0 00010000:00080000:3.0:1790096822.146168:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffc64a80 x1877052324114176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096822.146181:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324114176:0@lo:400:kworker.0 00000100:00100000:0.0:1790096822.146348:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096822.146388:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324114048:0@lo:400:kworker.0 00000100:00100000:0.0:1790096822.146425:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096822.147393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324113536 00000100:00100000:3.0:1790096822.147418:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324113536 00000100:00100000:3.0:1790096822.147473:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1790096822.147482:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096822.147552:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324113536:12345-0@lo:400:kworker.0 Request processed in 71us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096822.147559:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790096822.148857:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324113536:0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.149017:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114048 00000100:00100000:1.0:1790096822.149025:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114048 00000100:00100000:1.0:1790096822.149110:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790096822.149119:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096822.149189:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324114048:12345-0@lo:400:kworker.0 Request processed in 72us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.149196:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1790096822.149270:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096822.149330:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324114048:0@lo:400:kworker.0 00000100:00100000:3.0:1790096822.442852:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096822.442955:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096822.444237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203456 00000100:00100000:1.0:1790096822.444250:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203456 00000100:00100000:1.0:1790096822.444391:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:1.0:1790096822.444401:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096822.445539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203328 00000100:00100000:2.0:1790096822.445553:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203328 00000100:00100000:2.0:1790096822.445615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:2.0:1790096822.445623:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305203328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096822.445770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305203328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 147us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096822.445778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:1.0:1790096822.446104:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1704us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.446113:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00080000:3.0:1790096822.446788:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096822.461798:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096822.461873:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096822.462001:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203584 00000100:00100000:1.0:1790096822.462013:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203584 00000100:00100000:1.0:1790096822.462104:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790096822.462116:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2359:x1877052305203584:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:1.0:1790096822.462153:0:6694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5a64 00000100:00080000:1.0:1790096822.462164:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9eaafb3c0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790096822.462226:0:6694:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790096822.462540:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+2:2359:x1877052305203584:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 426us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.462548:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790096822.462929:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203712 00000100:00100000:0.0:1790096822.462938:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203712 00000100:00100000:0.0:1790096822.462990:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790096822.463000:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305203712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096822.463049:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305203712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096822.463056:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00080000:3.0:1790096822.463133:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790096822.463139:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790096822.463150:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096822.653050:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096822.653074:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324114304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096822.653153:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096822.653379:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114304 00000100:00100000:1.0:1790096822.653388:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114304 00000100:00100000:1.0:1790096822.653436:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790096822.653446:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324114304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096822.653482:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096822.653535:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324114304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096822.653543:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1790096822.653623:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6c380 x1877052324114304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096822.653670:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324114304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096822.845610:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790096823.720302:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:3.0:1790096823.720315:0:6721:0:(genops.c:885:class_export_put()) final put ffff9eaafb3c5000/7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:2.0:1790096823.720391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafb3c5000/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-OST0000 00000020:00000080:2.0:1790096823.720455:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaafb3c0800 for lustre-OST0000 00010000:00010000:0.0:1790096823.870000:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096824.894022:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096825.213841:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096825.214005:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324114432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096825.214073:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096825.214308:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114432 00000100:00100000:2.0:1790096825.214319:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114432 00000100:00100000:2.0:1790096825.214391:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790096825.214401:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324114432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096825.214437:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096825.214482:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324114432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096825.214489:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1790096825.214583:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096825.214619:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324114432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790096825.930698:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096826.940914:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096827.263137:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096827.263161:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324114816:0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.263161:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324114944:0@lo:400:kworker.0 00000100:00100000:0.0:1790096827.263277:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324115072:0@lo:400:kworker.0 00000040:00080000:3.0:1790096827.263782:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790096827.263848:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324114688:0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.264351:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096827.264405:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324114560:0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.264455:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096827.264501:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114944 00000100:00100000:1.0:1790096827.264509:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114944 00000100:00100000:1.0:1790096827.264561:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790096827.264570:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324114944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096827.264575:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096827.264618:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324114944:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096827.264625:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790096827.264628:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114816 00000100:00100000:2.0:1790096827.264631:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114816 00000100:00100000:2.0:1790096827.264679:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790096827.264685:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324114816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096827.264721:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324114816:12345-0@lo:400:kworker.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096827.264906:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096827.264984:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790096827.264998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324115072 00000100:00100000:2.0:1790096827.265002:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324115072 00000100:00100000:2.0:1790096827.265074:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790096827.265081:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324115072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096827.265261:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324115072:12345-0@lo:400:kworker.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096827.265267:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790096827.265536:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324115072:0@lo:400:kworker.0 00000100:00100000:2.0:1790096827.265664:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324114816:0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.265781:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114560 00000100:00100000:1.0:1790096827.265786:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114560 00000100:00100000:1.0:1790096827.265824:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1790096827.265830:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324114560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096827.266402:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096827.266438:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324115200:0@lo:400:kworker.0 00000100:00100000:3.0:1790096827.266478:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096827.266534:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324115200 00000100:00100000:3.0:1790096827.266539:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324115200 00000100:00100000:3.0:1790096827.266573:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790096827.266580:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324115200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096827.266618:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324115200:12345-0@lo:400:kworker.0 Request processed in 39us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096827.266625:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1790096827.266710:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096827.266716:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790096827.266719:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790096827.266902:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffc65880 x1877052324115200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790096843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096827.266916:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324115200:0@lo:400:kworker.0 00000100:00100000:0.0:1790096827.266972:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324114688 00000100:00100000:0.0:1790096827.266978:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324114688 00000100:00100000:0.0:1790096827.267022:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790096827.267030:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324114688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.267038:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324114560:12345-0@lo:400:kworker.0 Request processed in 1140us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096827.267048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1790096827.267088:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324114688:12345-0@lo:400:kworker.0 Request processed in 58us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096827.267104:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790096827.267107:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324114944:0@lo:400:kworker.0 00000100:00100000:1.0:1790096827.267123:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324114560:0@lo:400:kworker.0 00000100:00100000:2.0:1790096827.267199:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324114688:0@lo:400:kworker.0 00000001:02000400:3.0:1790096827.439539:0:11872:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:07:05 (1790096825) 00000100:00100000:3.0:1790096827.561575:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096827.561953:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096827.561989:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096827.562019:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204096 00000100:00100000:3.0:1790096827.562038:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204096 00000100:00100000:3.0:1790096827.562105:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203968 00000100:00100000:3.0:1790096827.562109:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203968 00000100:00100000:3.0:1790096827.562132:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1790096827.562141:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305204096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096827.562209:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305204096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096827.562217:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1790096827.562235:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1790096827.562241:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096827.562266:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305203968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096827.562286:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00080000:3.0:1790096827.562305:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096827.563142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305203840 00000100:00100000:0.0:1790096827.563150:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305203840 00000100:00100000:0.0:1790096827.563187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:0.0:1790096827.563195:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305203840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096827.563237:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305203840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096827.563245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:2.0:1790096827.773165:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096827.773233:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096827.773389:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324115328 00000100:00100000:1.0:1790096827.773397:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324115328 00000100:00100000:1.0:1790096827.773448:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790096827.773458:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324115328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096827.773492:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096827.774799:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324115328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1335us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096827.774818:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790096827.777044:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe6dc00 x1877052324115328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096827.777091:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324115328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096827.967179:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096828.989363:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096829.009448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096829.012157:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204224 00000100:00100000:0.0:1790096829.012175:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204224 00000100:00100000:0.0:1790096829.012545:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1790096829.012561:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+5:10234:x1877052305204224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096829.012727:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096829.012751:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820efa expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.012814:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.012828:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.012852:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096829.012886:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790096829.012905:0:8484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1790096829.012915:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1790096829.012949:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.012975:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820efa expref: 7 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.012993:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820efa expref: 6 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096829.013002:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7a00) 00010000:00010000:0.0:1790096829.013005:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790096829.013009:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690200, rc 0) 00000100:00100000:0.0:1790096829.013095:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:10234:x1877052305204224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 540us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096829.013102:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790096829.025308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096829.028107:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204352 00000100:00100000:3.0:1790096829.028124:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204352 00000100:00100000:3.0:1790096829.028200:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790096829.028210:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:10235:x1877052305204352:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096829.028232:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096829.028254:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f01 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028318:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028333:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028345:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028358:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028364:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028370:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028630:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028660:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028667:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096829.028693:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096829.028698:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096829.028719:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028730:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028737:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028744:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028750:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096829.028754:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028761:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028774:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7a00) 00010000:00010000:3.0:1790096829.028962:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096829.028968:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028975:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028990:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.028996:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029002:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029007:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096829.029010:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029016:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029023:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096829.029026:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096829.029029:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029034:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5b4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029068:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f01 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029095:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f01 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096829.029103:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaac2c3c400) 00010000:00010000:3.0:1790096829.029106:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096829.029108:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7800, rc 0) 00000100:00100000:3.0:1790096829.029268:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:10235:x1877052305204352:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1059us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096829.029276:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790096829.038923:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096829.039978:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204608 00000100:00100000:1.0:1790096829.039991:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204608 00000100:00100000:1.0:1790096829.040106:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1790096829.040116:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:10235:x1877052305204608:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096829.040138:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096829.040159:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f08 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.040235:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.040251:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.040262:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.043975:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044001:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044016:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044404:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b400/0xcc97d9eae5ab5b6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044414:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b400/0xcc97d9eae5ab5b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044433:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b400/0xcc97d9eae5ab5b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096829.044446:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790096829.044602:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044610:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044618:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044624:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096829.044629:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044676:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044692:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaac2c3c400) 00010000:00010000:1.0:1790096829.044695:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096829.044700:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044707:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044720:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044725:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044738:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044742:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096829.044744:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044749:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044756:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096829.044759:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096829.044761:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.044766:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.046745:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f08 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.046768:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b400/0xcc97d9eae5ab5b6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f08 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096829.047984:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:1.0:1790096829.047992:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096829.047998:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b400, rc 0) 00000100:00100000:1.0:1790096829.048089:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10235:x1877052305204608:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 7971us (9172us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790096829.048111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790096829.054567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096829.054696:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204736 00000100:00100000:1.0:1790096829.054707:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204736 00000100:00100000:1.0:1790096829.054778:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790096829.054788:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10235:x1877052305204736:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790096829.054909:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10235:x1877052305204736:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096829.054917:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000040:00080000:3.0:1790096829.311236:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790096830.012976:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096830.336006:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096830.336031:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096830.336103:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096830.336598:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324115456 00000100:00100000:2.0:1790096830.336607:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324115456 00000100:00100000:2.0:1790096830.336710:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790096830.336719:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324115456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096830.336753:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096830.336799:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324115456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096830.336805:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1790096830.337019:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096830.337059:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096830.889147:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096830.889188:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305204864 00000100:00100000:1.0:1790096830.889198:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305204864 00000100:00100000:1.0:1790096830.889255:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1790096830.889266:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10277:x1877052305204864:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096830.889286:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096830.889307:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f0f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889370:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889384:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889399:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889413:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889432:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889438:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889662:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889669:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889675:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889682:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096830.889686:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889694:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889766:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7a00) 00010000:00010000:1.0:1790096830.889770:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096830.889775:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889782:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889794:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889807:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889813:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889817:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096830.889820:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889826:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889843:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eaac4db7000) 00010000:00010000:1.0:1790096830.889846:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096830.889849:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889855:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889885:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f0f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889893:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7a00) 00010000:00010000:1.0:1790096830.889895:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096830.889899:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f0f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.889907:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a800, rc 0) 00000100:00100000:1.0:1790096830.889965:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10277:x1877052305204864:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 701us (827us total) trans 0 rc 301/301 00000100:00100000:1.0:1790096830.889972:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1790096830.903971:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096830.906798:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205120 00000100:00100000:1.0:1790096830.906811:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205120 00000100:00100000:1.0:1790096830.906884:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790096830.906893:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10277:x1877052305205120:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:1.0:1790096830.906948:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096830.907006:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5b36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820efa expref: 9 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907023:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7a00) 00010000:00010000:1.0:1790096830.907034:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096830.907262:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907276:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907287:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907299:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907307:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.907314:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096830.911363:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790096830.911385:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911395:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911402:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911408:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096830.911412:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911421:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911436:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:1.0:1790096830.911439:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096830.911444:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096830.911450:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5b91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096830.911470:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a292628c reply state 0000000035f83665 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096830.911479:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790096830.911926:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:10277:x1877052305205120:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 5029us (7959us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790096830.911946:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00010000:00010000:2.0:1790096830.914854:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914872:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914880:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914887:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096830.914891:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914899:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914915:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eaac4db7300) 00010000:00010000:2.0:1790096830.914919:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096830.914936:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096830.914943:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5b98 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096830.999291:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096830.999532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205248 00000100:00100000:3.0:1790096830.999541:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205248 00000100:00100000:3.0:1790096830.999602:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1790096830.999612:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:10285:x1877052305205248:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:3.0:1790096830.999684:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096830.999718:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5b9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f16 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999782:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999795:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999807:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096830.999867:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096830.999871:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096830.999921:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999947:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5b9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f16 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999965:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f16 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096830.999974:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096830.999977:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096830.999980:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6200, rc 0) 00000100:00100000:3.0:1790096831.000043:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+10:10285:x1877052305205248:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 432us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096831.000050:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00010000:00010000:0.0:1790096831.037808:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096831.090992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.091097:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205376 00000100:00100000:2.0:1790096831.091107:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205376 00000100:00100000:2.0:1790096831.091182:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790096831.091193:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+10:10291:x1877052305205376:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096831.091212:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.091230:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5bad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f1d expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091286:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091299:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091310:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091325:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091332:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091338:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091446:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091454:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091461:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096831.091484:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790096831.091487:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096831.091521:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091531:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091538:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091544:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091549:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096831.091553:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091560:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091571:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096831.091579:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096831.091585:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091591:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091604:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091610:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091616:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091621:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096831.091623:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091629:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091687:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eaac4e7a000) 00010000:00010000:2.0:1790096831.091690:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096831.091693:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790096831.091845:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790096831.091933:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5bbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091967:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f1d expref: 12 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.091992:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f1d expref: 11 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.092000:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096831.092002:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790096831.092005:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8800, rc 0) 00000100:00100000:2.0:1790096831.092098:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10291:x1877052305205376:12345-192.168.203.11@tcp:101:bash.0 Request processed in 908us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.092106:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790096831.109167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096831.109893:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205632 00000100:00100000:1.0:1790096831.109903:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205632 00000100:00100000:1.0:1790096831.110012:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1790096831.110022:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10291:x1877052305205632:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790096831.110042:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096831.110062:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5bc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f24 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.110206:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.110220:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.110232:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.111668:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.111684:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.111694:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790096831.112310:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790096831.112500:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112517:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112525:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112564:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112571:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112579:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112586:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096831.112591:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112598:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112612:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096831.112615:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096831.112620:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112626:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096831.112663:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089649fce reply state 0000000092faaf23 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096831.112679:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790096831.112716:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5bc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112731:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.112738:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:1.0:1790096831.112740:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096831.112743:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a400, rc 0) 00000100:00100000:1.0:1790096831.117152:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:10291:x1877052305205632:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7119us (7980us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790096831.117166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00010000:00010000:1.0:1790096831.122868:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122886:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122894:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122900:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096831.122904:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122913:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122947:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096831.122950:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096831.122955:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.122961:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096831.123122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096831.123591:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205760 00000100:00100000:1.0:1790096831.123600:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205760 00000100:00100000:2.0:1790096831.123684:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790096831.123693:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1877052305205760:12345-192.168.203.11@tcp:8:bash.0 00010000:00080000:2.0:1790096831.123725:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:2.0:1790096831.123753:0:6694:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab5bec 00002000:00100000:2.0:1790096831.123765:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7428525e-2b7d-490f-8a81-8b717b826fb3/ffff9eaac7fde000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790096831.123789:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790096831.124022:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790096831.124051:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9eaac7fde800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096831.124194:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305205760:12345-192.168.203.11@tcp:8:bash.0 Request processed in 500us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.124202:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790096831.130034:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.130204:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305205888 00000100:00100000:2.0:1790096831.130214:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305205888 00000100:00100000:2.0:1790096831.130336:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790096831.130353:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:0:x1877052305205888:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096831.130371:0:7012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.130393:0:7012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f2b expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096831.130430:0:7012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096831.130446:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1790096831.130450:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096831.130458:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 7 pid: 7012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.130477:0:7012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 7 pid: 7012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.130496:0:7012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096831.130552:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:0:x1877052305205888:12345-192.168.203.11@tcp:101:bash.0 Request processed in 201us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.130559:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00080000:0.0:1790096831.131997:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790096831.137195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.138108:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305206016 00000100:00100000:2.0:1790096831.138119:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305206016 00000100:00100000:2.0:1790096831.138178:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1790096831.138187:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:10291:x1877052305206016:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096831.138204:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.138221:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f32 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.138271:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 8 pid: 7012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.138280:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096831.138284:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096831.138289:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.138425:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 8 pid: 7012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.138438:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 8 pid: 7012 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096831.138453:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324115584:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096831.138539:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2fe5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790096831.148770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.149087:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305206144 00000100:00100000:3.0:1790096831.149097:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305206144 00010000:00010000:3.0:1790096831.149135:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 9 pid: 7012 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096831.149176:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790096831.149185:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305206144:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096831.149198:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096831.149218:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 9 pid: 7012 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.149242:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 9 pid: 7012 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.149268:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096831.149272:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096831.149280:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.149291:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.149324:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096831.149348:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb520380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1877052324115712:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790096831.149418:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d240 going to sleep for 11 seconds 00010000:00010000:2.0:1790096831.151341:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab5bf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f2b expref: 9 pid: 7012 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096831.151361:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324115584:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096831.151391:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.151403:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096831.151699:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:10291:x1877052305206016:12345-192.168.203.11@tcp:101:bash.0 Request processed in 13512us (14510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.151708:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790096831.155626:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb520380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1877052324115712:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790096831.156479:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096831.156907:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.159002:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305206400 00000100:00100000:3.0:1790096831.159015:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305206400 00000100:00100000:3.0:1790096831.159104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790096831.159127:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10291:x1877052305206400:12345-192.168.203.11@tcp:35:bash.0 00000001:00080000:3.0:1790096831.159472:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:3.0:1790096831.159667:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10291:x1877052305206400:12345-192.168.203.11@tcp:35:bash.0 Request processed in 551us (2760us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790096831.159690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000020:00080000:3.0:1790096831.159696:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790096831.161261:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305206144:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 12069us (12491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.161273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790096831.266813:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.267104:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305206656 00000100:00100000:2.0:1790096831.267113:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305206656 00000100:00100000:2.0:1790096831.267172:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1790096831.267181:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10301:x1877052305206656:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096831.267205:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.267225:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096831.267306:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790096831.267413:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5c01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f39 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.267428:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096831.267430:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096831.267435:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f39 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.267448:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096831.267513:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10301:x1877052305206656:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 333us (709us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1790096831.267520:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096831.274948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.275290:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305206912 00000100:00100000:3.0:1790096831.275301:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305206912 00000100:00100000:3.0:1790096831.275486:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790096831.275497:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10301:x1877052305206912:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096831.275769:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10301:x1877052305206912:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 274us (830us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790096831.275777:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790096831.378115:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.378235:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207040 00000100:00100000:2.0:1790096831.378256:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207040 00000100:00100000:2.0:1790096831.378320:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790096831.378331:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10307:x1877052305207040:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096831.378355:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.378375:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f40 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378442:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378457:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378469:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096831.378501:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790096831.378506:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096831.378523:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378550:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f40 expref: 19 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378568:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f40 expref: 18 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.378577:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096831.378579:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096831.378595:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8400, rc 0) 00000100:00100000:2.0:1790096831.378671:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10307:x1877052305207040:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 342us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.378678:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790096831.387918:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.388514:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207296 00000100:00100000:2.0:1790096831.388529:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207296 00000100:00100000:3.0:1790096831.389465:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790096831.389479:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10307:x1877052305207296:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096831.389500:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096831.389519:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f47 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.389616:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5c24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.389630:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.389672:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096831.389685:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790096831.389814:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f47 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.389859:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5c24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f47 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.389867:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:3.0:1790096831.389870:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096831.389873:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7600, rc 0) 00000100:00100000:3.0:1790096831.389956:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:10307:x1877052305207296:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 481us (2054us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790096831.389964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1790096831.393972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096831.399914:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207552 00000100:00100000:1.0:1790096831.399929:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207552 00000100:00100000:1.0:1790096831.400027:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790096831.400044:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+20:10307:x1877052305207552:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096831.400070:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096831.400093:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f4e expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.400215:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.400230:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.401847:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096831.401897:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790096831.402040:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f4e expref: 23 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.402063:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f4e expref: 22 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.402072:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:1.0:1790096831.402074:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790096831.402078:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17aa00, rc 0) 00000100:00100000:0.0:1790096831.404115:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.404352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207680 00000100:00100000:2.0:1790096831.404361:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207680 00000100:00100000:2.0:1790096831.404421:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790096831.404430:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:2363:x1877052305207680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096831.404443:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096831.404466:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5c24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f47 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.404484:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:2.0:1790096831.404489:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096831.404619:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2363:x1877052305207680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 189us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.404627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790096831.404654:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10307:x1877052305207552:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3973us (10045us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790096831.404662:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790096831.415309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096831.415533:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207808 00000100:00100000:1.0:1790096831.415542:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207808 00000100:00100000:1.0:1790096831.415601:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1790096831.415611:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305207808:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1790096831.415691:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.415712:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.415719:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096831.415723:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096831.415728:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.415910:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.415925:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 7 pid: 6695 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096831.415939:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324115840:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096831.416033:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707600 going to sleep for 11 seconds 00000100:00100000:1.0:1790096831.419594:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324115840:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096831.419624:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096831.419794:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.420057:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305207936 00000100:00100000:2.0:1790096831.420064:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305207936 00002000:00100000:2.0:1790096831.420104:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9eaafb83b100 x1877052305207936/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:147/0 lens 504/0 e 0 to 0 dl 1790096842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096831.420113:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafb83b100 with x1877052305207936 ext(0->12) 00010000:00010000:2.0:1790096831.420120:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 8 pid: 6695 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.420151:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 8 pid: 6695 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096831.420159:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafb83b100 00000100:00100000:2.0:1790096831.420230:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790096831.420241:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305207936:12345-192.168.203.11@tcp:4:lfs.0 00000001:00100000:0.0:1790096831.453245:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000100:00100000:2.0:1790096831.455037:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305207936:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 34782us (35229us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790096831.455052:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:2.0:1790096831.455067:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9eaafb83b100 x1877052305207936/t4294967299(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:147/0 lens 504/448 e 0 to 0 dl 1790096842 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096831.455077:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafb83b100 with x1877052305207936 ext(0->12) 00010000:00010000:2.0:1790096831.455089:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.455110:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096831.455118:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafb83b100 00000100:00100000:3.0:1790096831.460320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.460546:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305208064 00000100:00100000:2.0:1790096831.460556:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305208064 00010000:00010000:2.0:1790096831.460601:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096831.460775:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790096831.460859:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2361:x1877052305208064:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096831.460874:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790096831.460896:0:11191:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790096831.460899:0:11191:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790096831 00002000:00010000:2.0:1790096831.460902:0:11191:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790096831 00002000:00010000:2.0:1790096831.460904:0:11191:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790096831 00010000:00010000:2.0:1790096831.460910:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.460926:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.460953:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab5bfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f32 expref: 9 pid: 6695 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.460969:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1790096831.460974:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096831.460980:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.460990:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.461908:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096831.461989:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2361:x1877052305208064:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1131us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.461999:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00010000:00010000:1.0:1790096831.465543:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.465565:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.465603:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466517:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466553:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466561:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096831.466565:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466575:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466597:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.466604:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006301592b/0xcc97d9eae5ab5c47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096831.467011:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305207808:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 51396us (51705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096831.467021:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790096831.472617:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096831.472875:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305208320 00000100:00100000:1.0:1790096831.472884:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305208320 00000100:00100000:1.0:1790096831.472941:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1790096831.472951:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10307:x1877052305208320:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1790096831.473007:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f4e expref: 21 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096831.473285:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790096831.473529:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1790096831.475188:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:1.0:1790096831.475262:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.475280:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.475288:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.475931:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096831.475948:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 25 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096831.475961:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324115968:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096831.476230:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707000 going to sleep for 11 seconds 00000100:00100000:0.0:1790096831.479764:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad1858000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324115968:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096831.479804:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096831.486975:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.487077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305208448 00000100:00100000:2.0:1790096831.487087:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305208448 00010000:00010000:2.0:1790096831.487127:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 26 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096831.487167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1790096831.487177:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+26:2363:x1877052305208448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096831.487190:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096831.487197:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 26 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487210:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 26 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5bde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f24 expref: 26 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487247:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:2.0:1790096831.487252:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487260:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487267:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.487314:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096831.487382:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+25:2363:x1877052305208448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 206us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.487390:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00010000:00010000:3.0:1790096831.488314:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.488388:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096831.488586:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1790096831.489070:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790096831.489186:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb523800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324116096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790096831.489285:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096831.489448:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096831.495035:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116096 00000100:00100000:0.0:1790096831.495054:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116096 00000100:00100000:0.0:1790096831.495168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096831.495179:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324116096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790096831.495322:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324116096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 145us (6036us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096831.495339:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096831.495558:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb523800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324116096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790096831.496297:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1790096831.496396:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324116224:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1790096831.496441:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096831.496450:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096831.496473:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096831.497096:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116224 00000100:00100000:0.0:1790096831.497105:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116224 00000100:00100000:0.0:1790096831.497151:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096831.497159:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324116224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790096831.498570:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1877052324116224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1406us (2114us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790096831.498580:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790096831.501617:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324116224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790096831.502074:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1790096831.502142:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502154:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502161:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502167:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096831.502172:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502180:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502196:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:3.0:1790096831.502199:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790096831.502204:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.502211:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5c4e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790096831.502483:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790096831.503053:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1790096831.503066:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361073430139ns, next at 362073427797ns, rc = 0 00000001:00080000:3.0:1790096831.503074:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1790096831.503115:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7000) 00010000:00010000:3.0:1790096831.503120:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790096831.503138:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f4e expref: 29 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096831.503309:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:10307:x1877052305208320:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 30358us (30700us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790096831.503319:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000020:00080000:3.0:1790096831.503334:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790096831.509719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.509956:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305208576 00000100:00100000:2.0:1790096831.509967:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305208576 00000100:00100000:2.0:1790096831.510028:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790096831.510037:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+28:10307:x1877052305208576:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096831.510060:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.510083:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f55 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.510138:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f55 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.510152:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f55 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.510170:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096831.510173:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096831.510189:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096831.510244:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10307:x1877052305208576:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 208us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.510251:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1790096831.516398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096831.516533:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305208832 00000100:00100000:0.0:1790096831.516543:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305208832 00000100:00100000:0.0:1790096831.516685:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790096831.516704:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10307:x1877052305208832:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096831.516974:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+30:10307:x1877052305208832:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 280us (652us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1790096831.516983:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096831.646021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.646448:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305209088 00000100:00100000:2.0:1790096831.646471:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305209088 00000100:00100000:2.0:1790096831.646540:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790096831.646551:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+30:10317:x1877052305209088:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096831.646574:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096831.646593:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f5c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096831.646915:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790096831.647033:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5c5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f5c expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.647204:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096831.647208:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096831.647214:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f5c expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.647228:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9600, rc 0) 00000100:00100000:2.0:1790096831.647298:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+31:10317:x1877052305209088:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 748us (1285us total) trans 4294967328 rc 301/301 00000100:00100000:2.0:1790096831.647307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:1.0:1790096831.650493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096831.650600:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305209216 00000100:00100000:0.0:1790096831.650622:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305209216 00000100:00100000:0.0:1790096831.650718:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:0.0:1790096831.650729:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+31:10317:x1877052305209216:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790096831.650801:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.650819:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.650840:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.650855:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651129:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651138:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651231:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651255:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651263:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096831.651306:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651319:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651325:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651331:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651337:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096831.651341:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651349:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651359:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096831.651362:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096831.651367:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651373:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5c6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651393:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651400:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651406:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651411:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096831.651414:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651421:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651428:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096831.651430:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096831.651433:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651438:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651453:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651459:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651465:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651476:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096831.651479:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651484:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651491:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096831.651493:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096831.651496:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096831.651501:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096831.651631:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+31:10317:x1877052305209216:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 903us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096831.651664:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790096831.655574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.656674:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305209472 00000100:00100000:3.0:1790096831.656687:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305209472 00000100:00100000:3.0:1790096831.657089:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096831.657099:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+31:10317:x1877052305209472:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096831.657344:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:10317:x1877052305209472:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 246us (1777us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790096831.657352:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790096831.719880:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.719970:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305209728 00000100:00100000:3.0:1790096831.719980:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305209728 00000100:00100000:3.0:1790096831.720092:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790096831.720103:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:10321:x1877052305209728:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096831.720139:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096831.720181:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f63 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720258:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720273:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720316:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720332:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720340:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720347:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720470:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720479:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720486:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096831.720497:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790096831.720596:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720603:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720611:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720617:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096831.720681:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720690:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720702:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:3.0:1790096831.720705:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096831.720710:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720716:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab5c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720730:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720736:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720742:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720747:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096831.720749:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720754:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720761:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096831.720763:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096831.720773:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096831.720789:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab5c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.721064:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.721099:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.721107:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096831.721109:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096831.721111:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6400, rc 0) 00000100:00100000:2.0:1790096831.721181:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10321:x1877052305209728:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1079us (1309us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790096831.721189:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1790096831.739813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096831.740124:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305209856 00000100:00100000:2.0:1790096831.740134:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305209856 00000100:00100000:2.0:1790096831.740206:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790096831.740218:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad1858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10321:x1877052305209856:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790096831.740283:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740299:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740311:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740338:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740345:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740369:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740376:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096831.740380:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740387:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740399:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096831.740402:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096831.740406:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096831.740412:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5ca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096831.740519:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad1858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10321:x1877052305209856:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 304us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096831.740528:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1790096831.744461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096831.748340:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305210112 00000100:00100000:3.0:1790096831.748355:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305210112 00000100:00100000:3.0:1790096831.748434:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790096831.748445:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10321:x1877052305210112:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096831.749024:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+35:10321:x1877052305210112:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 579us (4571us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1790096831.749178:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00010000:00010000:0.0:1790096832.062347:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096832.177073:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096832.177247:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305210368 00000100:00100000:1.0:1790096832.177270:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305210368 00000100:00100000:1.0:1790096832.177332:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:1.0:1790096832.177343:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+35:10352:x1877052305210368:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1790096832.177365:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096832.177384:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f6a expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.177485:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.177499:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.177509:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096832.177519:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790096832.177683:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f6a expref: 38 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.177702:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f6a expref: 37 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.177710:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:1.0:1790096832.177712:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096832.177716:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b600, rc 0) 00000100:00100000:1.0:1790096832.177779:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10352:x1877052305210368:12345-192.168.203.11@tcp:101:cat.0 Request processed in 438us (715us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790096832.177786:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790096832.186322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096832.186361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.186434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305210752 00000100:00100000:2.0:1790096832.186444:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305210752 00000100:00100000:2.0:1790096832.186509:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790096832.186518:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+37:2360:x1877052305210752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096832.186531:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096832.186555:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f6a expref: 37 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.186590:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096832.186594:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096832.186679:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:2360:x1877052305210752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096832.186687:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790096832.187828:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305210624 00000100:00100000:1.0:1790096832.187839:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305210624 00000100:00100000:1.0:1790096832.187902:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790096832.187910:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:10352:x1877052305210624:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:1.0:1790096832.188137:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10352:x1877052305210624:12345-192.168.203.11@tcp:35:cat.0 Request processed in 227us (1822us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1790096832.188145:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790096832.262723:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.262830:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211008 00000100:00100000:2.0:1790096832.262841:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211008 00000100:00100000:2.0:1790096832.262890:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1790096832.262900:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10358:x1877052305211008:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1790096832.262925:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096832.262928:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790096832.262955:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f40 expref: 37 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.262974:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096832.262979:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096832.262991:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5cbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f71 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.263086:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.263100:0:7513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.263109:0:7513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.263154:0:7513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.263242:0:7513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 37 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096832.263255:0:7513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324116352:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096832.263448:0:7513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790096832.269461:0:7513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324116352:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096832.269493:0:7513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096832.269666:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.269748:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211136 00000100:00100000:2.0:1790096832.269755:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211136 00010000:00010000:2.0:1790096832.269785:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 38 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096832.269835:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790096832.269844:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+38:2362:x1877052305211136:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096832.269861:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096832.269869:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 38 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269881:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 38 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269925:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab5c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f63 expref: 38 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269941:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096832.269946:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269955:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269964:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.269997:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096832.270043:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+37:2362:x1877052305211136:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096832.270051:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00010000:00010000:3.0:1790096832.270148:0:7513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.270155:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096832.270187:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790096832.270360:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5cbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 38 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.270375:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 37 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.270383:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:3.0:1790096832.270386:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790096832.270389:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9400, rc 0) 00000100:00100000:3.0:1790096832.270414:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10358:x1877052305211008:12345-192.168.203.11@tcp:101:dd.0 Request processed in 7516us (7701us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1790096832.270428:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1790096832.277271:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.277356:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211392 00000100:00100000:2.0:1790096832.277366:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211392 00000100:00100000:2.0:1790096832.277430:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1790096832.277446:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10358:x1877052305211392:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:2.0:1790096832.277759:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.277776:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.277787:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096832.277996:0:5853:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1790096832.278028:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008887deba reply state 0000000092709287 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096832.278037:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096832.278148:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+40:10358:x1877052305211392:12345-192.168.203.11@tcp:36:dd.0 Request processed in 702us (882us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1790096832.278156:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000020:00080000:2.0:1790096832.278165:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790096832.279812:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279835:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279844:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279852:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096832.279856:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279865:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279880:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:3.0:1790096832.279883:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096832.279887:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.279893:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096832.381183:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324116864:0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381251:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096832.381322:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790096832.381327:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324116480:0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381359:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096832.381381:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324116992:0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381400:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096832.381427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116480 00000100:00100000:3.0:1790096832.381434:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116480 00000100:00100000:3.0:1790096832.381476:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790096832.381485:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324116480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381533:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324116480:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096832.381541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790096832.381596:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324116480:0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381618:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116992 00000100:00100000:3.0:1790096832.381621:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116992 00000100:00100000:3.0:1790096832.381688:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790096832.381695:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324116992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096832.381729:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324116992:12345-0@lo:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096832.381735:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790096832.381759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324116992:0@lo:400:kworker.0 00000100:00080000:3.0:1790096832.381776:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096832.381976:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324116608:0@lo:400:kworker.0 00000100:00100000:1.0:1790096832.382007:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096832.382038:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790096832.382043:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324116736:0@lo:400:kworker.0 00000100:00100000:1.0:1790096832.382064:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096832.382088:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116608 00000100:00100000:1.0:1790096832.382092:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116608 00000100:00100000:1.0:1790096832.382113:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116736 00000100:00100000:1.0:1790096832.382116:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116736 00000100:00100000:1.0:1790096832.382134:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790096832.382140:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324116608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096832.382172:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324116608:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096832.382179:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790096832.382193:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790096832.382198:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324116736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096832.382220:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324116736:12345-0@lo:400:kworker.0 Request processed in 23us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096832.382226:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790096832.382260:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324116736:0@lo:400:kworker.0 00000100:00100000:1.0:1790096832.382269:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324116608:0@lo:400:kworker.0 00000100:00100000:0.0:1790096832.382454:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324116864 00000100:00100000:0.0:1790096832.382459:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324116864 00000100:00100000:0.0:1790096832.382498:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790096832.382506:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324116864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096832.382550:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324116864:12345-0@lo:400:kworker.0 Request processed in 45us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096832.382563:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790096832.382596:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324116864:0@lo:400:kworker.0 00000100:00080000:3.0:1790096832.382719:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096832.382723:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096832.587345:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096832.587435:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211520 00000100:00100000:1.0:1790096832.587444:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211520 00000100:00100000:1.0:1790096832.587520:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790096832.587531:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+39:10372:x1877052305211520:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:1.0:1790096832.587558:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096832.587581:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587681:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587700:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587713:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587728:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587735:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587741:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587847:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587890:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 40 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587898:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587931:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 40 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.587946:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 40 pid: 7513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096832.587960:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324117120:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096832.588123:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707240 going to sleep for 11 seconds 00000100:00100000:2.0:1790096832.596397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096832.596503:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211776 00000100:00100000:0.0:1790096832.596512:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211776 00000100:00100000:0.0:1790096832.596573:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1790096832.596583:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+41:5599:x1877052305211776:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790096832.597315:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+42:5599:x1877052305211776:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 731us (925us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1790096832.597323:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790096832.598017:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324117120:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096832.598053:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096832.605351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.605569:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305211904 00000100:00100000:2.0:1790096832.605579:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305211904 00010000:00010000:2.0:1790096832.605622:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 42 pid: 7513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096832.605702:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790096832.605712:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+42:2362:x1877052305211904:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096832.605726:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096832.605733:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 42 pid: 7513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605746:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 42 pid: 7513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605767:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f71 expref: 42 pid: 7513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605801:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096832.605807:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605827:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605835:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.605873:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096832.606003:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606011:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096832.606063:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790096832.606068:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096832.606110:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606133:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606142:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606149:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606156:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606161:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096832.606166:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606173:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606182:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096832.606185:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096832.606188:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606194:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606205:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606211:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606223:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606228:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096832.606231:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606238:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606246:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096832.606248:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096832.606251:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606257:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606292:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f78 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606306:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f78 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096832.606313:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:1.0:1790096832.606315:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096832.606318:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a800, rc 0) 00000100:00100000:2.0:1790096832.606361:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+41:2362:x1877052305211904:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 651us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096832.606369:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1790096832.608428:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+40:10372:x1877052305211520:12345-192.168.203.11@tcp:101:stat.0 Request processed in 20889us (21081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096832.608470:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790096832.683052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096832.683109:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.683139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212032 00000100:00100000:2.0:1790096832.683152:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212032 00000100:00100000:3.0:1790096832.683157:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.683220:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:2.0:1790096832.683238:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305212032:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096832.683331:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2361:x1877052305212032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096832.683390:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212288 00000100:00100000:0.0:1790096832.683395:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212288 00000100:00100000:0.0:1790096832.683444:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:0.0:1790096832.683451:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305212288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096832.683482:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2361:x1877052305212288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096832.683489:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00080000:0.0:1790096832.683513:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096832.683962:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212160 00000100:00100000:1.0:1790096832.683968:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212160 00000100:00100000:1.0:1790096832.684001:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1790096832.684008:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305212160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096832.684060:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305212160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096832.684067:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1790096832.690953:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:3.0:1790096832.743404:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096832.743598:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212544 00000100:00100000:2.0:1790096832.743609:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212544 00000100:00100000:2.0:1790096832.743720:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1790096832.743731:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+40:10378:x1877052305212544:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:2.0:1790096832.743797:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096832.743844:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f78 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.743863:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096832.743867:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096832.744073:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.744086:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096832.744097:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096832.744163:0:5853:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:2.0:1790096832.744188:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f625d911 reply state 000000009694d6a6 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096832.744197:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096832.744303:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+42:10378:x1877052305212544:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 574us (907us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1790096832.744311:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000020:00080000:2.0:1790096832.744315:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790096832.748757:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748789:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748797:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748803:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096832.748809:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748825:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748841:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:3.0:1790096832.748844:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096832.748849:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096832.748856:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5cf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790096832.893384:0:8073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362463747057ns, next at 363463744722ns, rc = 0 00000100:00100000:3.0:1790096832.893716:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790096832.893739:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324117248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096832.893954:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096832.894139:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324117248 00000100:00100000:0.0:1790096832.894147:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324117248 00000100:00100000:0.0:1790096832.894206:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790096832.894215:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324117248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096832.894253:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096832.894306:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324117248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096832.894330:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790096832.894478:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324117248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096833.010522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096833.010607:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212672 00000100:00100000:1.0:1790096833.010617:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212672 00000100:00100000:1.0:1790096833.010726:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790096833.010736:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+41:10392:x1877052305212672:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:1.0:1790096833.010761:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096833.010942:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f7f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011017:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011030:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011039:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011052:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011063:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011069:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790096833.011225:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790096833.011858:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011869:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011876:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096833.011911:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1790096833.011915:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096833.011933:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011942:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011950:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011955:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011961:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011979:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096833.011983:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.011990:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012001:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096833.012004:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096833.012010:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012015:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012027:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012032:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012037:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012041:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096833.012043:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012049:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012062:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096833.012064:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096833.012066:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012071:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012100:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012112:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.012118:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:1.0:1790096833.012120:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096833.012122:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a400, rc 0) 00000100:00100000:1.0:1790096833.012360:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+42:10392:x1877052305212672:12345-192.168.203.11@tcp:101:stat.0 Request processed in 1624us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096833.012369:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:0.0:1790096833.085003:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096833.110347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.110450:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305212928 00000100:00100000:0.0:1790096833.110460:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305212928 00000100:00100000:0.0:1790096833.110528:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1790096833.110539:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+42:10402:x1877052305212928:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096833.110561:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096833.110585:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f86 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096833.110709:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790096833.110846:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f86 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.110859:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096833.110862:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096833.110867:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f86 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.110880:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:0.0:1790096833.110940:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+43:10402:x1877052305212928:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 403us (601us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1790096833.110948:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1790096833.123336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.123622:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305213184 00000100:00100000:3.0:1790096833.123690:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305213184 00000100:00100000:3.0:1790096833.123756:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790096833.123767:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+43:10402:x1877052305213184:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096833.124010:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+44:10402:x1877052305213184:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 244us (683us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1790096833.124017:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790096833.233889:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096833.234103:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305213440 00000100:00100000:1.0:1790096833.234112:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305213440 00000100:00100000:1.0:1790096833.234206:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1790096833.234217:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+44:10408:x1877052305213440:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790096833.234239:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096833.234259:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5d27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f8d expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.234369:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.234385:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.234393:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.234428:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.234518:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 45 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096833.234531:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff780380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324117376:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096833.234869:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707600 going to sleep for 11 seconds 00000100:00100000:1.0:1790096833.244092:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.244319:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305213568 00000100:00100000:0.0:1790096833.244328:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305213568 00010000:00010000:0.0:1790096833.244384:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 46 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096833.244430:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790096833.244452:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+46:2363:x1877052305213568:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096833.244466:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096833.244473:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 46 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.244486:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 46 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.244509:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096833.244515:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.244525:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.244533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.244553:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096833.244607:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+46:2363:x1877052305213568:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 168us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096833.244624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00010000:00010000:2.0:1790096833.245415:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f7f expref: 45 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096833.245432:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff780380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324117376:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096833.245574:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.245584:0:8484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.245600:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096833.245943:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790096833.246100:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5d27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 46 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.246114:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 45 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.246121:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096833.246124:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790096833.246127:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b600, rc 0) 00000100:00100000:2.0:1790096833.246223:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+45:10408:x1877052305213440:12345-192.168.203.11@tcp:101:bash.0 Request processed in 12008us (12342us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1790096833.246231:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790096833.254865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096833.254948:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305213824 00000100:00100000:1.0:1790096833.254958:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305213824 00000100:00100000:1.0:1790096833.255055:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790096833.255065:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+45:10408:x1877052305213824:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:1.0:1790096833.255339:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.255356:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.255384:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096833.255433:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1790096833.255459:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008993a505 reply state 00000000d22fc14a transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096833.255469:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790096833.255562:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+48:10408:x1877052305213824:12345-192.168.203.11@tcp:36:bash.0 Request processed in 498us (706us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1790096833.255570:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000020:00080000:1.0:1790096833.255575:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790096833.262125:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262144:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262152:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262158:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096833.262163:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262189:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262206:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096833.262209:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096833.262215:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.262221:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096833.275531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096833.275674:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305213952 00000100:00100000:2.0:1790096833.275690:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305213952 00000100:00100000:2.0:1790096833.275829:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1790096833.275840:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10408:x1877052305213952:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096833.275864:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096833.275946:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab5d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f94 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.276028:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.276042:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 48 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.276049:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.276079:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 48 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.276105:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 48 pid: 8484 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096833.276119:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324117504:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096833.276952:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096833.279844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.280032:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305214080 00000100:00100000:0.0:1790096833.280040:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305214080 00010000:00010000:0.0:1790096833.280078:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 49 pid: 8484 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096833.280136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096833.280145:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+49:2362:x1877052305214080:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096833.280161:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096833.280168:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 49 pid: 8484 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.280179:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 49 pid: 8484 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.280201:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096833.280206:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.280215:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.280221:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.280237:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096833.280286:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+49:2362:x1877052305214080:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096833.280293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00010000:00010000:2.0:1790096833.280577:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f8d expref: 48 pid: 8484 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096833.280592:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324117504:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096833.280610:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.280618:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.280623:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096833.280708:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790096833.280713:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096833.280730:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.280895:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab5d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f94 expref: 48 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.280911:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f94 expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.280930:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096833.280933:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096833.280935:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8000, rc 0) 00000100:00100000:2.0:1790096833.280976:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10408:x1877052305213952:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5138us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096833.280982:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790096833.286272:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096833.286347:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305214336 00000100:00100000:2.0:1790096833.286357:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305214336 00000100:00100000:2.0:1790096833.286462:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1790096833.286473:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10408:x1877052305214336:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1790096833.286761:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+48:10408:x1877052305214336:12345-192.168.203.11@tcp:35:bash.0 Request processed in 291us (498us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1790096833.286768:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790096833.418169:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096833.418623:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305214592 00000100:00100000:2.0:1790096833.418683:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305214592 00000100:00100000:2.0:1790096833.418742:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790096833.418752:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+48:10418:x1877052305214592:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096833.418775:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096833.418799:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab5d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820f9b expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096833.418904:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790096833.419057:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab5d51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f9b expref: 50 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.419095:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096833.419098:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096833.419104:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab5d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f9b expref: 50 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.419120:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096833.419191:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10418:x1877052305214592:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 440us (1031us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1790096833.419198:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1790096833.430549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096833.430711:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305214720 00000100:00100000:1.0:1790096833.430724:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305214720 00000100:00100000:1.0:1790096833.431186:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790096833.431199:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10418:x1877052305214720:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1790096833.431280:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431296:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431322:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431340:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431347:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431369:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431476:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431485:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431491:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096833.431532:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431545:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431552:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431558:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431564:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096833.431568:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431575:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431587:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096833.431596:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096833.431602:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431608:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5d5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431623:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431629:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431909:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431914:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096833.431917:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431923:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431931:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096833.431934:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096833.431937:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431943:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431957:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431969:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431974:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431979:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096833.431982:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431988:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.431994:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:1.0:1790096833.431996:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096833.431999:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096833.432003:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096833.432118:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10418:x1877052305214720:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 920us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096833.432126:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790096833.434332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.434502:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305214976 00000100:00100000:0.0:1790096833.434512:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305214976 00000100:00100000:0.0:1790096833.434626:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790096833.434667:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10418:x1877052305214976:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096833.434938:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10418:x1877052305214976:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 302us (625us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1790096833.434945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790096833.513519:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.513629:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305215232 00000100:00100000:0.0:1790096833.513676:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305215232 00000100:00100000:2.0:1790096833.514188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1790096833.514200:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10421:x1877052305215232:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096833.514224:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096833.514247:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab5d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fa2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514324:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514339:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514350:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514365:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514395:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514402:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514538:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab5d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514547:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.514553:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096833.514563:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790096833.515200:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515211:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515219:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515225:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096833.515229:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515237:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515267:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096833.515270:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096833.515276:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515281:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515297:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515303:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515308:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515313:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096833.515316:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515322:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515328:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4e7ae00) 00010000:00010000:2.0:1790096833.515330:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096833.515333:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515338:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515398:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab5d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa2 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515414:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab5d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa2 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.515421:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096833.515423:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096833.515425:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9e00, rc 0) 00000100:00100000:2.0:1790096833.515520:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10421:x1877052305215232:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1322us (2012us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790096833.515529:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1790096833.519516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.520202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305215360 00000100:00100000:0.0:1790096833.520214:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305215360 00000100:00100000:0.0:1790096833.520288:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790096833.520298:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+52:2360:x1877052305215360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096833.520313:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096833.520338:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab5d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa2 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.520355:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096833.520360:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096833.520419:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+51:2360:x1877052305215360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 123us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096833.520426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790096833.521969:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.522055:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305215488 00000100:00100000:0.0:1790096833.522064:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305215488 00000100:00100000:0.0:1790096833.522115:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1790096833.522123:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+51:10421:x1877052305215488:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790096833.522185:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522201:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522229:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522257:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522264:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522270:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522276:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096833.522281:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522288:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522299:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096833.522302:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096833.522306:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.522312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096833.522457:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+51:10421:x1877052305215488:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 334us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096833.522464:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790096833.526290:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.526386:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305215744 00000100:00100000:3.0:1790096833.526397:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305215744 00000100:00100000:3.0:1790096833.526469:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790096833.526479:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+51:10421:x1877052305215744:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096833.526734:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10421:x1877052305215744:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 256us (455us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1790096833.526741:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790096833.785231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.785341:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216000 00000100:00100000:3.0:1790096833.785350:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216000 00000100:00100000:3.0:1790096833.785411:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1790096833.785431:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10439:x1877052305216000:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790096833.785474:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096833.785494:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.785591:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5da5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.785607:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5da5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.785618:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5da5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096833.785664:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790096833.786067:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa9 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.786085:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa9 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.786093:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:3.0:1790096833.786096:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790096833.786100:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6c00, rc 0) 00000100:00100000:3.0:1790096833.786274:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10439:x1877052305216000:12345-192.168.203.11@tcp:101:cat.0 Request processed in 845us (1052us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1790096833.786282:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1790096833.850886:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096833.851300:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216128 00000100:00100000:2.0:1790096833.851310:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216128 00000100:00100000:2.0:1790096833.851377:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790096833.851387:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10440:x1877052305216128:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096833.851411:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096833.851431:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fb0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851496:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851522:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851551:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096833.851583:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790096833.851587:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096833.851603:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851966:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab5db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb0 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851986:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb0 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096833.851995:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096833.851998:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096833.852002:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8200, rc 0) 00000100:00100000:2.0:1790096833.852066:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10440:x1877052305216128:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 680us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096833.852074:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790096833.858930:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.859022:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216512 00000100:00100000:3.0:1790096833.859033:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216512 00000100:00100000:3.0:1790096833.859101:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790096833.859138:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10440:x1877052305216512:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096833.859489:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10440:x1877052305216512:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 353us (569us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1790096833.859496:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096833.863488:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.864268:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216640 00000100:00100000:3.0:1790096833.864279:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216640 00000100:00100000:3.0:1790096833.864351:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790096833.864361:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10440:x1877052305216640:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:3.0:1790096833.864377:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790096833.864403:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab5d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f94 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.864426:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fa9 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.864438:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab5c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f55 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.864447:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:3.0:1790096833.864458:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096833.864722:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10440:x1877052305216640:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 360us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096833.864730:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790096833.880109:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096833.880361:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216768 00000100:00100000:0.0:1790096833.880385:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216768 00000100:00100000:0.0:1790096833.880445:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790096833.880455:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10440:x1877052305216768:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1790096833.880586:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.880602:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.880628:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096833.880975:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096833.882540:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790096833.883324:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790096833.883458:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10440:x1877052305216768:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 3000us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096833.883469:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790096833.928577:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096833.928627:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305216896 00000100:00100000:3.0:1790096833.928655:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305216896 00000100:00100000:3.0:1790096833.928733:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1790096833.928744:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10442:x1877052305216896:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096833.928764:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096833.928783:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5dc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fb7 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928858:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928872:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928884:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928896:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928902:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.928909:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929127:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929137:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929145:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096833.929188:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790096833.929192:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096833.929209:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929220:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929228:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929234:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929242:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929248:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096833.929252:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929261:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929272:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:3.0:1790096833.929275:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096833.929280:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929285:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab5dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929308:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929315:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929320:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929325:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096833.929328:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929334:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929341:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096833.929343:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096833.929346:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929352:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929382:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5dc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 55 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929396:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 54 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096833.929414:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:3.0:1790096833.929416:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096833.929420:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6800, rc 0) 00000100:00100000:3.0:1790096833.929485:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10442:x1877052305216896:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 743us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096833.929494:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000001:00080000:3.0:1790096833.967182:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:3.0:1790096833.967206:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1790096833.967249:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000020:00080000:3.0:1790096833.967277:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaae6a2e240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1790096833.967282:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac30daa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaac78de300 00000020:00080000:3.0:1790096833.967285:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac30da200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaafb424000 00000001:00080000:3.0:1790096833.967299:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:3.0:1790096833.967317:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1790096833.967338:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1790096833.967466:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790096833.967663:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790096833.967694:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324117632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790096833.967761:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096833.967837:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324117632 00000100:00100000:0.0:1790096833.967845:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324117632 00000100:00100000:0.0:1790096833.967900:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790096833.967910:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1877052324117632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790096833.967937:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1790096833.967975:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6ab2b5bf, atime: 0x6ab2b5bf, ctime: 0x6ab2b5bf, blocks: 0x1 00010000:00010000:0.0:1790096833.967983:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968020:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1790096833.968025:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096833.968032:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968052:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968062:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968070:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968087:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790096833.968527:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1877052324117632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 617us (764us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790096833.968535:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1790096833.968559:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790096833.968571:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096833.968578:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968586:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096833.968590:0:7651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968610:0:7651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968628:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968662:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5de4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096833.968680:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096833.968682:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096833.968684:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790096833.968715:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaee6a7100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790096833.968722:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324117632:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790096834.108954:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096834.429219:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096834.429228:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096834.429284:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790096834.429291:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096834.429415:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc64700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324117760:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790096834.429522:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096834.433549:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc64700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324117760:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790096834.440244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.440570:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217024 00000100:00100000:0.0:1790096834.440582:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217024 00000100:00100000:0.0:1790096834.440684:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790096834.440695:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217024:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790096834.440781:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217024:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 87us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.440789:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790096834.445507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.445593:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217152 00000100:00100000:1.0:1790096834.445615:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217152 00000100:00100000:1.0:1790096834.445711:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790096834.445933:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217152:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790096834.445969:0:5853:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790096834.446125:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217152:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 393us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.446133:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790096834.456593:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.457240:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217280 00000100:00100000:2.0:1790096834.457322:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217280 00000100:00100000:2.0:1790096834.457434:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1790096834.457445:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217280:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790096834.457517:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457535:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457548:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457616:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457630:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457670:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457902:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457911:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.457918:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096834.457972:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790096834.457977:0:8484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096834.458097:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458110:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458117:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458125:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458131:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096834.458136:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458144:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458156:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096834.458159:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096834.458163:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458169:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5deb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458181:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458196:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458202:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458206:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096834.458209:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458214:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458222:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9eaac4e7aa00) 00010000:00010000:2.0:1790096834.458224:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096834.458226:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458232:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5df2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458244:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458250:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458255:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458259:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096834.458268:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458274:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458281:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:2.0:1790096834.458283:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096834.458286:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.458290:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.458418:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217280:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 972us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096834.458427:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1790096834.463550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.464039:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217536 00000100:00100000:0.0:1790096834.464051:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217536 00000100:00100000:0.0:1790096834.464150:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1790096834.464174:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10453:x1877052305217536:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096834.464197:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096834.464218:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5e00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464314:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464329:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464341:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096834.464352:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790096834.464539:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464548:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464554:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464560:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.464564:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464571:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464583:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096834.464593:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790096834.464598:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464623:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464791:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5e00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fbe expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464810:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:0.0:1790096834.464812:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096834.464816:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5e00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fbe expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.464827:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096834.464896:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305217536:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 725us (1356us total) trans 4294967352 rc 301/301 00000100:00100000:0.0:1790096834.464903:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1790096834.478109:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.478193:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217664 00000100:00100000:1.0:1790096834.478203:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217664 00000100:00100000:1.0:1790096834.478426:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790096834.478436:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305217664:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790096834.478470:0:5853:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790096834.478578:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305217664:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 143us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.478585:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790096834.499510:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.499810:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305217920 00000100:00100000:2.0:1790096834.499821:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305217920 00000100:00100000:2.0:1790096834.499880:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1790096834.499889:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305217920:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096834.499909:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096834.499912:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790096834.499938:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.499956:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096834.499961:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096834.499972:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fc5 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790096834.505118:0:8484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1790096834.505437:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.505455:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.505467:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.505539:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fc5 expref: 14 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.506380:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fc5 expref: 13 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.506390:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:2.0:1790096834.506392:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096834.506395:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9600, rc 0) 00000100:00100000:2.0:1790096834.506455:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305217920:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 6567us (6957us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790096834.506463:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1790096834.518184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.519152:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218176 00000100:00100000:0.0:1790096834.519164:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218176 00000100:00100000:0.0:1790096834.519237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:0.0:1790096834.519247:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305218176:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096834.519300:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096834.519325:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fc5 expref: 13 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.519353:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:0.0:1790096834.519364:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096834.519386:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.519400:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.519411:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.520817:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.520835:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.520845:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521091:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521100:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521107:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521112:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.521118:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521137:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521150:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096834.521153:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096834.521157:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521164:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5e2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521175:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521181:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521187:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521192:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.521195:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521200:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521207:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf7267861 (ffff9eaac3cb7200) 00010000:00010000:0.0:1790096834.521209:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096834.521212:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.521227:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7267861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.521339:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305218176:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 2089us (3162us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096834.521348:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:0.0:1790096834.523889:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.524112:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218304 00000100:00100000:1.0:1790096834.524122:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218304 00000100:00100000:1.0:1790096834.524217:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1790096834.524229:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305218304:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096834.524247:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096834.524267:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fcc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524298:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524310:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524327:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524410:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524426:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.524433:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096834.524436:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790096834.524439:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b600, rc 0) 00000100:00100000:1.0:1790096834.524491:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305218304:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 265us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.524498:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:2.0:1790096834.532103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.536951:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218560 00000100:00100000:1.0:1790096834.536969:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218560 00000100:00100000:2.0:1790096834.538844:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1790096834.538859:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305218560:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790096834.538951:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.538969:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.538980:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790096834.539260:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1790096834.539271:0:8484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364109635209ns, next at 365109632916ns, rc = 0 00000004:00010000:2.0:1790096834.539359:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d27e541 reply state 00000000bb9f09a5 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.539368:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096834.539520:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10453:x1877052305218560:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 662us (7425us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1790096834.539528:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1790096834.545066:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.545131:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218688 00000100:00100000:0.0:1790096834.545141:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218688 00000100:00100000:0.0:1790096834.545197:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1790096834.545208:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10453:x1877052305218688:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096834.545231:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096834.545253:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fd3 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.545324:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 16 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.545341:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 16 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.545361:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:0.0:1790096834.545365:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790096834.545369:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690c00, rc 0) 00000100:00100000:0.0:1790096834.545421:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10453:x1877052305218688:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 215us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.545440:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:1.0:1790096834.545631:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545664:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545670:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545675:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096834.545680:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545698:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545710:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096834.545713:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790096834.545717:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.545723:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5e46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.553023:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.553098:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218816 00000100:00100000:2.0:1790096834.553119:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218816 00000100:00100000:2.0:1790096834.553191:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1790096834.553202:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1877052305218816:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1790096834.553238:0:7012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:2.0:1790096834.553273:0:7012:0:(genops.c:1384:class_connect()) connect: client 7428525e-2b7d-490f-8a81-8b717b826fb3, cookie 0xcc97d9eae5ab5e54 00002000:00100000:2.0:1790096834.553286:0:7012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7428525e-2b7d-490f-8a81-8b717b826fb3/ffff9eaac3de6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790096834.553311:0:7012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790096834.553585:0:7012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790096834.553654:0:7012:0:(import.c:65:import_set_state_nolock()) ffff9eaac3de7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096834.553726:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2359:x1877052305218816:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 Request processed in 524us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096834.553735:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1790096834.558206:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096834.558822:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305218944 00000100:00100000:3.0:1790096834.558838:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305218944 00000100:00100000:3.0:1790096834.558915:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790096834.558927:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:0:x1877052305218944:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790096834.559218:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1790096834.652314:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000001:00080000:2.0:1790096834.652333:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1790096834.655867:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:0:x1877052305218944:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 96932us (97666us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790096834.655883:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790096834.660078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.660230:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305219200 00000100:00100000:2.0:1790096834.660240:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305219200 00000100:00100000:2.0:1790096834.660294:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790096834.660304:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10453:x1877052305219200:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790096834.665005:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10453:x1877052305219200:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 4688us (4924us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1790096834.665020:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000040:00080000:1.0:1790096834.674430:0:12022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096834.674439:0:12022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096834.674471:0:12022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790096834.674476:0:12022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096834.694244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.694306:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305219456 00000100:00100000:1.0:1790096834.694317:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305219456 00000100:00100000:1.0:1790096834.694376:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1790096834.694387:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10453:x1877052305219456:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790096834.694529:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10453:x1877052305219456:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 143us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.694537:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:2.0:1790096834.703911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096834.704010:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305219584 00000100:00100000:3.0:1790096834.704020:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305219584 00000100:00100000:3.0:1790096834.704081:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1790096834.704093:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10453:x1877052305219584:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096834.704113:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096834.704133:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fda expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704197:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704211:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704223:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096834.704256:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096834.704274:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704299:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab5e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fda expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704316:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fda expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.704337:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:3.0:1790096834.704340:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790096834.704343:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7200, rc 0) 00000100:00100000:3.0:1790096834.704397:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305219584:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 306us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096834.704403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1790096834.720747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.720908:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305219712 00000100:00100000:1.0:1790096834.720919:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305219712 00000100:00100000:1.0:1790096834.720994:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790096834.721006:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305219712:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096834.721027:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096834.721060:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fe1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790096834.721738:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2b5c2, blocks: 0x1 00010000:00010000:1.0:1790096834.721770:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1790096834.721775:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096834.721785:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.721819:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.721833:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17aa00, rc 0) 00000100:00100000:1.0:1790096834.721895:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305219712:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 891us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.721903:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790096834.729943:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096834.730756:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305219968 00000100:00100000:3.0:1790096834.730767:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305219968 00000100:00100000:3.0:1790096834.730862:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1790096834.730873:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305219968:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790096834.730978:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305219968:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 106us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096834.730985:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1790096834.749369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096834.749490:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220096 00000100:00100000:3.0:1790096834.749502:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220096 00000100:00100000:3.0:1790096834.749566:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790096834.749578:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:10453:x1877052305220096:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096834.749597:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096834.749616:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fe8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.749685:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.749708:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096834.749713:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096834.749720:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.749756:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.749771:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096834.749786:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1877052324117888:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096834.749890:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096834.762862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.762896:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220224 00000100:00100000:1.0:1790096834.762904:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220224 00010000:00010000:1.0:1790096834.762940:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 8 pid: 6696 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096834.763048:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1877052324117888:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096834.764017:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.764040:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6000, rc 0) 00000100:00100000:3.0:1790096834.765357:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:10453:x1877052305220096:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 15773us (15986us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096834.765370:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790096834.770854:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790096834.770878:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305220224:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096834.770900:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096834.770938:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.770956:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.770982:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5e69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe1 expref: 7 pid: 6696 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.770995:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096834.771000:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096834.771009:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.771020:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.771064:0:8472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.771078:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8472:1877052324118016:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790096834.771724:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2fe5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096834.788442:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.788547:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8472:1877052324118016:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790096834.788581:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096834.788760:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220352 00000100:00100000:3.0:1790096834.788779:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220352 00002000:00100000:3.0:1790096834.788836:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eaaffe98700 x1877052305220352/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:150/0 lens 504/0 e 0 to 0 dl 1790096845 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096834.788859:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaffe98700 with x1877052305220352 ext(0->8) 00002000:00010000:3.0:1790096834.788864:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaffe98700 00000100:00100000:3.0:1790096834.788903:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790096834.788913:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305220352:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790096834.789271:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305220224:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 18402us (26418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096834.789283:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790096834.790314:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305220352:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 1400us (1879us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790096834.790325:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:3.0:1790096834.790335:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eaaffe98700 x1877052305220352/t4294967302(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:150/0 lens 504/448 e 0 to 0 dl 1790096845 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096834.790343:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaffe98700 with x1877052305220352 ext(0->8) 00002000:00010000:3.0:1790096834.790348:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaffe98700 00000100:00100000:2.0:1790096834.800915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.800999:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220480 00000100:00100000:0.0:1790096834.801018:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220480 00000100:00100000:0.0:1790096834.801091:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1790096834.801102:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305220480:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790096834.861704:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305220480:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 60594us (60790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.861717:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000001:00080000:3.0:1790096834.862591:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1790096834.862605:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:3.0:1790096834.862611:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790096834.862660:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1790096834.862991:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1790096834.863002:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1790096834.864072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324118144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790096834.864449:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096834.864740:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.865324:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324118144 00000100:00100000:1.0:1790096834.865332:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324118144 00000100:00080000:0.0:1790096834.865386:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096834.865387:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220608 00000100:00100000:1.0:1790096834.865390:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220608 00000100:00100000:1.0:1790096834.865413:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790096834.865422:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324118144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790096834.865424:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1790096834.865431:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305220608:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1790096834.865579:0:7012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790096834.865583:0:7012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790096834 00002000:00010000:1.0:1790096834.865585:0:7012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790096834.865587:0:7012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790096834 -> 1790096834 00002000:00010000:1.0:1790096834.865590:0:7012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790096834.865660:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324118144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (1211us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790096834.865668:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1790096834.865714:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaee6a5500/2, rc 0, transno 4294967303 00000100:00100000:1.0:1790096834.865720:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324118144:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1790096834.916976:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1790096834.916995:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1790096834.917301:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305220608:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 51864us (52557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.917312:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1790096834.923277:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.926186:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220864 00000100:00100000:1.0:1790096834.926202:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220864 00000100:00100000:1.0:1790096834.926270:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:1.0:1790096834.926281:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305220864:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790096834.926333:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096834.926362:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab5e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fda expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.926379:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096834.926383:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096834.926427:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.926441:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.926451:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096834.927428:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c68a7db reply state 000000002855291a transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.927441:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790096834.927587:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:10453:x1877052305220864:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1307us (4316us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1790096834.927596:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00010000:00010000:0.0:1790096834.929448:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929463:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929471:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929494:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.929499:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929507:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929522:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:0.0:1790096834.929525:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096834.929529:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.929536:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.929971:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.930034:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305220992 00000100:00100000:0.0:1790096834.930044:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305220992 00000100:00100000:0.0:1790096834.930113:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1790096834.930126:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305220992:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790096834.930370:0:7012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790096834.930374:0:7012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790096834 -> 1790096833 00002000:00010000:0.0:1790096834.930377:0:7012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790096831 00002000:00010000:0.0:1790096834.930379:0:7012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790096834 -> 1790096833 00002000:00010000:0.0:1790096834.930381:0:7012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790096834.930434:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305220992:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 312us (467us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790096834.930441:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790096834.938565:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.938668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305221248 00000100:00100000:1.0:1790096834.938677:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305221248 00000100:00100000:1.0:1790096834.938726:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1790096834.938735:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10453:x1877052305221248:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790096834.938816:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.938834:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.938844:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.938877:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.938903:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 13 pid: 5853 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.938918:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324118272:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096834.938995:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaca868240 going to sleep for 11 seconds 00000100:00100000:2.0:1790096834.949564:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096834.949668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305221376 00000100:00100000:3.0:1790096834.949678:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305221376 00010000:00010000:3.0:1790096834.949718:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 14 pid: 5853 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096834.949754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790096834.949763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2362:x1877052305221376:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096834.949777:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096834.949797:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 14 pid: 5853 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.949825:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 14 pid: 5853 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.949848:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:3.0:1790096834.949853:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.949863:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.949879:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.949897:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096834.949949:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2362:x1877052305221376:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 187us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096834.949957:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00010000:00010000:1.0:1790096834.951591:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fcc expref: 13 pid: 5853 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.951872:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324118272:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096834.951898:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.951950:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.951972:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952002:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952009:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952017:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952024:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.952029:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952036:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952050:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:0.0:1790096834.952053:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790096834.952057:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.952064:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5e7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.952142:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305221248:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 13406us (13583us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790096834.952168:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1790096834.960960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096834.961903:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305221504 00000100:00100000:1.0:1790096834.961915:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305221504 00000100:00100000:1.0:1790096834.961979:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1790096834.961990:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305221504:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790096834.962176:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.962198:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.962207:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096834.962211:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096834.962216:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.962263:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.962277:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 7 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.962291:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877052324118400:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096834.962383:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaca868240 going to sleep for 11 seconds 00000100:00100000:1.0:1790096834.969134:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877052324118400:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096834.969178:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.970707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.970811:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305221632 00000100:00100000:0.0:1790096834.970820:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305221632 00010000:00010000:0.0:1790096834.970859:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 8 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.970916:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1790096834.970926:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305221632:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096834.970940:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096834.970965:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 8 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.970977:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 8 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.971003:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080269305/0xcc97d9eae5ab5e70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fe8 expref: 8 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.971019:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790096834.971024:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790096834.971030:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.971047:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.971071:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096834.971129:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305221632:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.971161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00010000:00010000:1.0:1790096834.971913:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.971926:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.971954:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.971962:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.971985:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.971992:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096834.971996:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.972004:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.972018:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.972026:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ecda34c/0xcc97d9eae5ab5e85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096834.972099:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305221504:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 10111us (11147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096834.972108:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790096834.978747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.978850:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305221888 00000100:00100000:0.0:1790096834.978859:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305221888 00000100:00100000:0.0:1790096834.978924:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:0.0:1790096834.978934:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+12:10453:x1877052305221888:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790096834.979014:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979032:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979045:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979372:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979386:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 13 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979394:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979426:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 13 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.979439:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 13 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.979471:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324118528:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096834.979601:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb4af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096834.985172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096834.985288:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324118528:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096834.985312:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.985398:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305222016 00000100:00100000:2.0:1790096834.985406:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305222016 00010000:00010000:3.0:1790096834.985776:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 14 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096834.985872:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:3.0:1790096834.985884:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2362:x1877052305222016:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096834.985900:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096834.985907:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 14 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.985937:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 14 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.985960:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab5e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fd3 expref: 14 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.985976:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:3.0:1790096834.985981:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.985990:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.985997:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.986036:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096834.986090:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+13:2362:x1877052305222016:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 208us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096834.986098:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00010000:00010000:1.0:1790096834.986155:0:8484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096834.986163:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096834.986333:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1790096834.986495:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1790096834.986555:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1790096834.986704:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8484:1877052324118656:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790096834.986751:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096834.986779:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096834.989241:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324118656 00000100:00100000:0.0:1790096834.989255:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324118656 00000100:00100000:0.0:1790096834.989359:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790096834.989369:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8484:x1877052324118656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1790096834.989511:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8484:x1877052324118656:12345-0@lo:1000:mdt00_004.0 Request processed in 143us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096834.989518:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790096834.989601:0:8484:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1790096834.989618:0:8484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaee6a5500, transno 4294967303 00000100:00100000:1.0:1790096834.989662:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8484:1877052324118656:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1790096834.990188:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1790096834.990264:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8484:1877052324118784:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790096834.990307:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096834.991475:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3275f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096834.992147:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324118784 00000100:00100000:2.0:1790096834.992157:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324118784 00000100:00100000:2.0:1790096834.992206:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096834.992216:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8484:x1877052324118784:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790096834.992842:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8484:x1877052324118784:12345-0@lo:1000:mdt00_004.0 Request processed in 536us (2442us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790096834.992853:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790096834.992937:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8484:1877052324118784:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1790096834.993054:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993065:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993073:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993164:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096834.993169:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993177:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993192:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7d00) 00010000:00010000:3.0:1790096834.993194:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096834.993199:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993206:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5e93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993244:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993251:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993256:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993261:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096834.993376:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993386:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993406:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:3.0:1790096834.993408:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096834.993412:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993418:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5dc1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993438:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993452:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 16 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993524:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993560:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 16 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096834.993575:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 16 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096834.993588:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb500a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324118912:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096834.993739:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790096834.998257:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096834.998597:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305222144 00000100:00100000:2.0:1790096834.998607:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305222144 00010000:00010000:2.0:1790096834.998738:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 17 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096834.998947:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb500a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324118912:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096834.998972:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.999413:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790096834.999425:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+17:2363:x1877052305222144:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096834.999440:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096834.999447:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 17 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999526:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 17 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999567:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab5ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fb7 expref: 17 pid: 7513 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999582:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:2.0:1790096834.999587:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999597:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999604:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096834.999630:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096834.999671:0:8484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999680:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999692:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999699:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096834.999702:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+16:2363:x1877052305222144:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 279us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096834.999715:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00010000:00010000:0.0:1790096834.999720:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999728:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.999733:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999741:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999762:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096834.999765:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096834.999770:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999777:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab5e9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999789:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999795:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999812:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999818:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096834.999821:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999843:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999853:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096834.999855:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790096834.999859:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096834.999864:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5e8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096835.000194:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10453:x1877052305221888:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 21260us (21453us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1790096835.000203:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000020:00080000:0.0:1790096835.000207:0:8484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790096835.000963:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790096835.000968:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790096835.000996:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790096835.001023:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790096835.011389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096835.011608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305222400 00000100:00100000:1.0:1790096835.011618:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305222400 00000100:00100000:1.0:1790096835.011707:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790096835.011717:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10453:x1877052305222400:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790096835.012412:0:5854:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790096835.012532:0:5854:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1790096835.012576:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096835.012594:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096835.012606:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790096835.012627:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790096835.012629:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096835.012660:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096835.012666:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096835.012693:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790096835.012789:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10453:x1877052305222400:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1072us (1407us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790096835.012807:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000020:00080000:1.0:1790096835.012812:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790096835.012827:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096835.012836:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096835.012843:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096835.012847:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096835.012854:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096835.012866:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eaac4db7e00) 00010000:00010000:2.0:1790096835.012876:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790096835.012880:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096835.012886:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096835.012901:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096835.012902:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096835.012904:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096835.133338:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096835.456414:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324119040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096835.456529:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096835.456992:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324119040 00000100:00100000:2.0:1790096835.457021:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324119040 00000100:00100000:2.0:1790096835.457082:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790096835.457092:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324119040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096835.457116:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1790096835.457171:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324119040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096835.457178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790096835.457585:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324119040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790096836.157170:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790096836.549332:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790096836.549342:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790096836.549396:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790096836.549403:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1790096836.560592:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1790096836.560611:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1790096836.698052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096836.698089:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305222656 00000100:00100000:1.0:1790096836.698098:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305222656 00000100:00100000:1.0:1790096836.698856:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1790096836.698868:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+17:10471:x1877052305222656:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096836.698891:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096836.698912:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820fef expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.699054:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.699070:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.699098:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096836.699110:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790096836.699240:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fef expref: 20 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.699257:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fef expref: 19 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.699265:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096836.699268:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790096836.699272:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17ac00, rc 0) 00000100:00100000:1.0:1790096836.699327:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10471:x1877052305222656:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 462us (1285us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1790096836.699333:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1790096836.704485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.705543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305222784 00000100:00100000:0.0:1790096836.705555:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305222784 00000100:00100000:0.0:1790096836.705606:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1790096836.705625:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10471:x1877052305222784:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790096836.705740:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.705757:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.705768:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.705782:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.705797:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.705803:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706075:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706084:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706091:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096836.706134:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706147:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706160:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706166:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706172:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.706175:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706182:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706194:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096836.706197:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.706201:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706206:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706216:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706222:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706228:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706232:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.706241:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706246:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706253:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac3cb7500) 00010000:00010000:0.0:1790096836.706255:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.706258:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706263:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706277:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706282:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706287:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706291:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.706294:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706299:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706305:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7200) 00010000:00010000:0.0:1790096836.706306:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.706315:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.706320:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096836.706408:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10471:x1877052305222784:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 785us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096836.706416:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:1.0:1790096836.759849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.760629:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305223040 00000100:00100000:0.0:1790096836.760729:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305223040 00000100:00100000:1.0:1790096836.760923:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1790096836.760934:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10474:x1877052305223040:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096836.760954:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096836.760972:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ff6 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761272:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761288:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761314:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761331:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761339:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761345:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761759:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761770:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761778:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096836.761797:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790096836.761902:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761910:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761917:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761923:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.761934:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761942:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761955:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096836.761959:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096836.761964:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761970:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761983:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761989:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761994:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.761999:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.762002:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762006:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762013:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7800) 00010000:00010000:1.0:1790096836.762015:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096836.762891:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762904:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762960:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 22 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762975:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 21 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.762984:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096836.762987:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096836.762989:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b000, rc 0) 00000100:00100000:1.0:1790096836.763531:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10474:x1877052305223040:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2595us (3688us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1790096836.763541:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1790096836.772336:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096836.772445:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305223168 00000100:00100000:1.0:1790096836.772455:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305223168 00000100:00100000:1.0:1790096836.772567:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:1.0:1790096836.772579:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10474:x1877052305223168:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1790096836.772680:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772704:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772716:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772762:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772770:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772777:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772783:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.772799:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772806:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772818:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096836.772821:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790096836.772826:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.772832:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096836.772914:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10474:x1877052305223168:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 338us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096836.772922:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:0.0:1790096836.778745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096836.782935:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305223424 00000100:00100000:2.0:1790096836.782948:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305223424 00000100:00100000:2.0:1790096836.783009:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790096836.783019:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10474:x1877052305223424:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790096836.783376:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+22:10474:x1877052305223424:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 357us (4638us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790096836.783385:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790096836.813574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.813673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305223680 00000100:00100000:0.0:1790096836.813683:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305223680 00000100:00100000:0.0:1790096836.813741:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:0.0:1790096836.813751:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+22:9996:x1877052305223680:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096836.813774:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096836.813805:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5efc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3820ffd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.813930:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.813943:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 23 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.813952:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.813979:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 23 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.814005:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 23 pid: 8484 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096836.814017:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324119168:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096836.814282:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096836.819524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096836.820687:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305223808 00000100:00100000:2.0:1790096836.820856:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305223808 00010000:00010000:2.0:1790096836.820913:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 24 pid: 8484 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096836.820980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1790096836.820991:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:2362:x1877052305223808:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096836.821006:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096836.821014:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 24 pid: 8484 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096836.821296:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324119168:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096836.821364:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 24 pid: 8484 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.824805:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.826372:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab5ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ff6 expref: 24 pid: 8484 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.826402:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096836.826409:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.826419:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.826427:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.827062:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096836.827154:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:2362:x1877052305223808:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6162us (7642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096836.827165:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00010000:00010000:0.0:1790096836.832116:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.832142:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096836.832176:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790096836.832428:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5efc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.832454:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.832465:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096836.832469:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096836.832473:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691600, rc 0) 00000100:00100000:0.0:1790096836.832583:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:9996:x1877052305223680:12345-192.168.203.11@tcp:101:bash.0 Request processed in 18832us (19015us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790096836.832626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1790096836.836369:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096836.836500:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224064 00000100:00100000:3.0:1790096836.836515:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224064 00000100:00100000:3.0:1790096836.836603:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1790096836.836616:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+23:9996:x1877052305224064:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1790096836.837177:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.837201:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.837215:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096836.837275:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:3.0:1790096836.837302:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000839c29f5 reply state 00000000e800f60f transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096836.837312:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790096836.837360:0:8484:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:3.0:1790096836.837491:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+27:9996:x1877052305224064:12345-192.168.203.11@tcp:36:bash.0 Request processed in 875us (1134us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1790096836.837520:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000020:00080000:3.0:1790096836.837526:0:8484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790096836.842272:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842319:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842329:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842337:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.842344:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842354:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842377:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096836.842381:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096836.842387:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.842394:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab5f11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096836.845905:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096836.846212:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224192 00000100:00100000:3.0:1790096836.846226:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224192 00000100:00100000:3.0:1790096836.846310:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790096836.846323:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+26:9996:x1877052305224192:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096836.846356:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096836.846385:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab5f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821004 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.846466:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab5f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821004 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.846489:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab5f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821004 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.846513:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096836.846517:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096836.846521:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6a00, rc 0) 00000100:00100000:3.0:1790096836.846609:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+27:9996:x1877052305224192:12345-192.168.203.11@tcp:101:bash.0 Request processed in 288us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096836.846616:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790096836.850280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.850407:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224320 00000100:00100000:0.0:1790096836.850421:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224320 00000100:00100000:0.0:1790096836.850552:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1790096836.850566:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:9996:x1877052305224320:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096836.850588:0:7012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096836.850617:0:7012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382100b expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096836.850688:0:7012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2b5c1, atime: 0x6ab2b5bf, ctime: 0x6ab2b5c1, blocks: 0xb 00010000:00010000:0.0:1790096836.850717:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1790096836.850723:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096836.850732:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 7 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.850754:0:7012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 7 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.850769:0:7012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690600, rc 0) 00000100:00100000:0.0:1790096836.850860:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:9996:x1877052305224320:12345-192.168.203.11@tcp:101:bash.0 Request processed in 297us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096836.850868:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00080000:3.0:1790096836.851984:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096836.853755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096836.853871:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224448 00000100:00100000:2.0:1790096836.853884:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224448 00002000:00010000:2.0:1790096836.853940:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1790096836.853947:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee6a4700 with x1877052305224448 ext(0->18446744073709551615) 00002000:00010000:2.0:1790096836.853963:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee6a4700. 00000100:00100000:2.0:1790096836.854022:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790096836.854033:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305224448:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:2.0:1790096836.854399:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790096836.854404:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790096833 -> 1790096836 00002000:00010000:2.0:1790096836.854406:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790096831 -> 1790096831 00002000:00010000:2.0:1790096836.854408:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790096833 -> 1790096836 00002000:00010000:2.0:1790096836.854411:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790096836.854556:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305224448:12345-192.168.203.11@tcp:10:bash.0 Request processed in 524us (813us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790096836.854565:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00010000:2.0:1790096836.854569:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1790096836.854572:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee6a4700 with x1877052305224448 ext(0->18446744073709551615) 00002000:00010000:2.0:1790096836.854578:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee6a4700. 00000100:00100000:2.0:1790096836.898964:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.899084:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224576 00000100:00100000:0.0:1790096836.899097:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224576 00000100:00100000:0.0:1790096836.899200:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:0.0:1790096836.899212:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:10489:x1877052305224576:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790096836.899305:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899326:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899338:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899355:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899362:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899369:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899689:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899699:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899705:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096836.899752:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899765:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899778:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899796:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899803:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.899808:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899817:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899830:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096836.899833:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.899839:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899846:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899860:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899866:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899872:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899877:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.899886:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899893:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899900:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096836.899902:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.899905:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899911:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899927:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899933:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899939:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899944:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096836.899946:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899952:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899957:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096836.899959:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096836.899965:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096836.899972:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab5f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096836.900054:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:10489:x1877052305224576:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 844us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096836.900062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1790096836.931915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096836.934877:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224832 00000100:00100000:1.0:1790096836.934900:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224832 00000100:00100000:1.0:1790096836.935005:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1790096836.935019:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+27:10492:x1877052305224832:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096836.935048:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096836.935075:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821012 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935226:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935243:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935256:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935274:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935281:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.935288:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937082:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937106:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937119:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096836.937134:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790096836.937270:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937278:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937297:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937304:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.937308:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937317:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937332:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096836.937336:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096836.937342:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937349:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5f42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937365:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937372:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937377:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937382:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096836.937385:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937401:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937410:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7800) 00010000:00010000:1.0:1790096836.937412:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096836.937415:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937420:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.937482:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821012 expref: 30 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.938431:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821012 expref: 29 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096836.938441:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096836.938444:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790096836.938447:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17aa00, rc 0) 00000100:00100000:1.0:1790096836.938548:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10492:x1877052305224832:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3531us (6646us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790096836.938559:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1790096836.944836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096836.944970:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305224960 00000100:00100000:3.0:1790096836.944985:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305224960 00000100:00100000:3.0:1790096836.945151:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1790096836.945167:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10492:x1877052305224960:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790096836.945268:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.945290:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.945301:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.945344:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.945361:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 29 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096836.945378:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb501500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324119296:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096836.945554:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318900 going to sleep for 11 seconds 00000100:00100000:3.0:1790096836.950719:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb501500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324119296:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096836.950759:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096836.951023:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096836.951088:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305225216 00000100:00100000:0.0:1790096836.951099:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305225216 00000100:00100000:0.0:1790096836.951174:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096836.951186:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+30:5598:x1877052305225216:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790096836.951686:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+31:5598:x1877052305225216:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 499us (662us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1790096836.951695:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1790096836.956247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096836.956357:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305225344 00000100:00100000:3.0:1790096836.956369:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305225344 00010000:00010000:3.0:1790096836.956419:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 31 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096836.956466:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790096836.956494:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:2363:x1877052305225344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096836.956512:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096836.956519:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 31 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956535:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 31 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956562:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab5f03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ffd expref: 31 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956583:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096836.956589:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956612:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956621:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096836.956715:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096836.956774:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+30:2363:x1877052305225344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 282us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096836.956782:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00010000:00010000:2.0:1790096836.956864:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956874:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956915:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956922:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956929:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956944:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096836.956949:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956957:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956967:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096836.956970:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096836.956975:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096836.956981:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab5f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096836.957027:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10492:x1877052305224960:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 11865us (12208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096836.957035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1790096836.960322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096836.960405:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305225600 00000100:00100000:2.0:1790096836.960419:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305225600 00000100:00100000:2.0:1790096836.960496:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1790096836.960508:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+29:10492:x1877052305225600:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790096836.960888:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+30:10492:x1877052305225600:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 381us (580us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790096836.960897:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1790096837.037369:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.037505:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305225856 00000100:00100000:2.0:1790096837.037519:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305225856 00000100:00100000:2.0:1790096837.037729:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1790096837.037765:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+30:10503:x1877052305225856:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790096837.037809:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096837.037841:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821019 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.037945:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.037963:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038220:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038239:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038247:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038254:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038613:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038624:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038668:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096837.038692:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790096837.038835:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038844:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038851:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038858:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096837.038864:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038872:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038888:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096837.038892:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096837.038898:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038905:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038918:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038925:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038942:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038949:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096837.038952:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.038958:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790096837.039950:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790096837.041290:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4e7a100) 00010000:00010000:2.0:1790096837.041301:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096837.041311:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.041321:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.041438:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab5f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821019 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.041457:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821019 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.041466:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096837.041468:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096837.041472:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096837.041585:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+32:10503:x1877052305225856:12345-192.168.203.11@tcp:101:cat.0 Request processed in 3823us (4226us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790096837.041616:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1790096837.051684:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.051771:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305226112 00000100:00100000:2.0:1790096837.051796:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305226112 00000100:00100000:2.0:1790096837.051885:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790096837.051898:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:10503:x1877052305226112:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:2.0:1790096837.052513:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+33:10503:x1877052305226112:12345-192.168.203.11@tcp:35:cat.0 Request processed in 614us (841us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790096837.052524:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000040:00080000:2.0:1790096837.052880:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096837.052887:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096837.052923:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790096837.052930:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790096837.106554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.109928:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305226368 00000100:00100000:1.0:1790096837.109978:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305226368 00000100:00100000:1.0:1790096837.110086:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1790096837.110099:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+33:10504:x1877052305226368:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1790096837.110181:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790096837.110221:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab5f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821019 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110253:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab5f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821012 expref: 32 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110266:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab5f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821004 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110280:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096837.110293:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096837.110320:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110337:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110348:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110365:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110372:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.110378:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.114279:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.114306:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.114322:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096837.117093:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1790096837.117108:0:8484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366687471981ns, next at 367687468542ns, rc = 0 00010000:00010000:0.0:1790096837.117185:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117203:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117225:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117236:0:8484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117243:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117250:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117287:0:8484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096837.117309:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117316:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117322:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117327:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.117332:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117339:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117351:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096837.117354:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790096837.117365:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117372:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab5f96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117393:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117400:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117406:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117411:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.117414:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117420:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117429:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096837.117432:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.117435:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.117441:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab5f88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096837.117451:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2ebb595 reply state 00000000793a854b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.117469:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096837.117565:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+32:10504:x1877052305226368:12345-192.168.203.11@tcp:36:rm.0 Request processed in 7465us (11022us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790096837.117575:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00010000:00010000:1.0:1790096837.118419:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096837.118428:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.118436:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096837.118440:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.118459:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.118471:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096837.118473:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790096837.118477:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.118482:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab5f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.118499:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096837.118501:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096837.118503:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096837.123511:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123530:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123538:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123544:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.123548:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123553:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123566:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7800) 00010000:00010000:0.0:1790096837.123568:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.123572:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.123576:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.167740:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.167887:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305226624 00000100:00100000:2.0:1790096837.167902:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305226624 00000100:00100000:2.0:1790096837.168050:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1790096837.168064:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+31:10510:x1877052305226624:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096837.168098:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096837.168128:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821020 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168302:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168320:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168334:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168366:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168373:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.168747:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790096837.169571:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790096837.169841:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169857:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169869:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169918:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169926:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169934:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169941:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096837.169946:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169968:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.169984:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096837.169987:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096837.169993:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.170000:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab5fab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790096837.170017:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34c9b03 reply state 00000000a8f14cc3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.170028:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790096837.170069:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab5fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.170084:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.170091:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:2.0:1790096837.170093:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096837.170095:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9400, rc 0) 00000100:00100000:2.0:1790096837.170204:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10510:x1877052305226624:12345-192.168.203.11@tcp:101:bash.0 Request processed in 2143us (2476us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790096837.170216:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00010000:00010000:3.0:1790096837.172624:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172679:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172687:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172694:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096837.172700:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172709:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172728:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4e7a100) 00010000:00010000:3.0:1790096837.172731:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096837.172736:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.172743:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab5fb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.174026:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.174133:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305226752 00000100:00100000:0.0:1790096837.174148:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305226752 00000100:00100000:0.0:1790096837.174263:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790096837.174273:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2361:x1877052305226752:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096837.174294:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096837.174315:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821027 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096837.174343:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096837.174365:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1790096837.174369:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096837.174377:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.174402:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.174413:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690200, rc 0) 00000100:00100000:0.0:1790096837.174474:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305226752:12345-192.168.203.11@tcp:101:bash.0 Request processed in 205us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096837.174480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00080000:3.0:1790096837.174855:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096837.178325:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.178522:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305226880 00000100:00100000:0.0:1790096837.178536:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305226880 00000100:00100000:1.0:1790096837.178748:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790096837.178820:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:10510:x1877052305226880:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790096837.178851:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096837.178876:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382102e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.179002:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.179013:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096837.179019:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096837.179024:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.179071:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.179086:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 7 pid: 6695 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.179102:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff129f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324119424:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096837.179313:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac556c480 going to sleep for 11 seconds 00010000:00010000:2.0:1790096837.180770:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096837.187678:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.187815:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305227008 00000100:00100000:3.0:1790096837.187829:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305227008 00010000:00010000:3.0:1790096837.187886:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 8 pid: 6695 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.187940:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790096837.187959:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305227008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096837.187981:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096837.188012:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 8 pid: 6695 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.188028:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 8 pid: 6695 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.188060:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096837.188065:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096837.188077:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.188088:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.188145:0:11191:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.188165:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11191:1877052324119552:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790096837.188414:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab5fc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821027 expref: 8 pid: 6695 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.188434:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff129f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324119424:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096837.188466:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.188478:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17aa00, rc 0) 00000100:00100000:3.0:1790096837.188553:0:11191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318900 going to sleep for 11 seconds 00000100:00100000:1.0:1790096837.188957:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:10510:x1877052305226880:12345-192.168.203.11@tcp:101:bash.0 Request processed in 10195us (10644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.188967:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790096837.204240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.205582:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11191:1877052324119552:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790096837.205613:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096837.205714:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305227008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 17756us (18085us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.205726:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:0.0:1790096837.209466:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305227264 00000100:00100000:0.0:1790096837.209486:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305227264 00000100:00100000:0.0:1790096837.209672:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790096837.209686:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+33:10510:x1877052305227264:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790096837.210226:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10510:x1877052305227264:12345-192.168.203.11@tcp:35:bash.0 Request processed in 541us (6688us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790096837.210253:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790096837.365491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.365966:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305227392 00000100:00100000:1.0:1790096837.365980:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305227392 00000100:00100000:1.0:1790096837.366064:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790096837.366078:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+34:10526:x1877052305227392:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096837.366111:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096837.366139:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821035 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366230:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366247:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366260:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096837.366302:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790096837.366306:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096837.366326:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366355:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab5fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821035 expref: 36 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366376:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821035 expref: 35 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.366420:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096837.366423:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096837.366428:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a400, rc 0) 00000100:00100000:1.0:1790096837.366518:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+35:10526:x1877052305227392:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 443us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.366526:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790096837.372759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.373129:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305227648 00000100:00100000:0.0:1790096837.373143:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305227648 00000100:00100000:0.0:1790096837.373223:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:0.0:1790096837.373236:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+35:10526:x1877052305227648:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096837.373265:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096837.373291:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5fe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382103c expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.373429:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.373447:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.373463:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096837.373476:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790096837.373680:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab5fe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382103c expref: 38 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.373703:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382103c expref: 37 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.373713:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:0.0:1790096837.373716:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096837.373720:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:0.0:1790096837.373831:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+37:10526:x1877052305227648:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 597us (1089us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790096837.373840:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:2.0:1790096837.380579:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.380879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.380997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305227776 00000100:00100000:3.0:1790096837.381016:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305227776 00000100:00100000:0.0:1790096837.381026:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228032 00000100:00100000:0.0:1790096837.381033:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228032 00000100:00100000:0.0:1790096837.381100:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:0.0:1790096837.381113:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+38:10526:x1877052305228032:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096837.381140:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096837.381168:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5ff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.381182:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790096837.381206:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+39:2362:x1877052305227776:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096837.381223:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096837.381247:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab5fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382103c expref: 39 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.381268:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:3.0:1790096837.381274:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096837.381297:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.381314:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.381326:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096837.381339:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:3.0:1790096837.381347:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+38:2362:x1877052305227776:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096837.381356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00010000:00010000:0.0:1790096837.382337:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab5ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821043 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.382534:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821043 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.382544:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:0.0:1790096837.382548:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790096837.382565:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691400, rc 0) 00000100:00100000:0.0:1790096837.382630:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+38:10526:x1877052305228032:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1519us (1751us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1790096837.383477:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:2.0:1790096837.391255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.391354:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228160 00000100:00100000:0.0:1790096837.391368:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228160 00000100:00100000:0.0:1790096837.391437:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1790096837.391450:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305228160:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:0.0:1790096837.391510:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.391538:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.391549:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096837.391554:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790096837.391560:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.391609:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.391627:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 6 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.391701:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324119680:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096837.391829:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:0.0:1790096837.399881:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324119680:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096837.399928:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.403632:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.403911:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228288 00000100:00100000:3.0:1790096837.403926:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228288 00002000:00100000:3.0:1790096837.403994:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eaafb155c00 x1877052305228288/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:153/0 lens 504/0 e 0 to 0 dl 1790096848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096837.404007:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafb155c00 with x1877052305228288 ext(0->8) 00010000:00010000:3.0:1790096837.404018:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 7 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.404040:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 7 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790096837.404049:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafb155c00 00000100:00100000:3.0:1790096837.404089:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790096837.404102:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305228288:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:3.0:1790096837.406285:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2361:x1877052305228288:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 2170us (2655us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790096837.406311:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00100000:3.0:1790096837.406327:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eaafb155c00 x1877052305228288/t4294967302(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:153/0 lens 504/448 e 0 to 0 dl 1790096848 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096837.406340:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafb155c00 with x1877052305228288 ext(0->8) 00010000:00010000:3.0:1790096837.406353:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.406386:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790096837.406396:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafb155c00 00000100:00100000:2.0:1790096837.415945:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.416049:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228416 00000100:00100000:1.0:1790096837.416064:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228416 00010000:00010000:1.0:1790096837.416122:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.416227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:1.0:1790096837.416248:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2360:x1877052305228416:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096837.416267:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790096837.416295:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790096837.416298:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790096837 00002000:00010000:1.0:1790096837.416300:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790096837 00002000:00010000:1.0:1790096837.416303:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790096837 00010000:00010000:1.0:1790096837.416310:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.416326:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.416394:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097fe8774/0xcc97d9eae5ab5fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382102e expref: 9 pid: 6696 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.416416:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096837.416421:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096837.416427:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.416438:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.416481:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096837.416569:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305228416:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 331us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.416577:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00010000:00010000:2.0:1790096837.417097:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417109:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417144:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417154:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417164:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417172:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096837.417177:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417200:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417219:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.417227:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092fe5373/0xcc97d9eae5ab600d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.417304:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305228160:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 25855us (26064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.417315:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790096837.420211:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.420387:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228672 00000100:00100000:3.0:1790096837.420400:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228672 00000100:00100000:3.0:1790096837.420478:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790096837.420490:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+38:10526:x1877052305228672:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:3.0:1790096837.420575:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821043 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096837.421090:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1790096837.421136:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1790096837.422000:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1790096837.422075:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.422099:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.422136:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.422184:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.422202:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 42 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.422219:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff122d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324119808:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096837.425488:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb3186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096837.430256:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff122d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324119808:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096837.430308:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.430891:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.432263:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228800 00000100:00100000:2.0:1790096837.432279:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228800 00010000:00010000:2.0:1790096837.432343:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 43 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.432401:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1790096837.433115:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+43:2362:x1877052305228800:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096837.433138:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096837.433165:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 43 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.433183:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 43 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.433216:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab5fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821020 expref: 43 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.433237:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:2.0:1790096837.433244:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.433256:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.433265:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.434885:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096837.434998:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+42:2362:x1877052305228800:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2578us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.435013:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:0.0:1790096837.435120:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.435132:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096837.436260:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1790096837.437074:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790096837.437255:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324119936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790096837.437532:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096837.437585:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb4af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096837.438334:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324119936 00000100:00100000:2.0:1790096837.438349:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324119936 00000100:00100000:2.0:1790096837.438449:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096837.438461:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324119936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1790096837.438689:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096837.439181:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324119936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 719us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.439212:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790096837.443068:0:5855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1790096837.443087:0:5855:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1790096837.443118:0:5855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaee6a7100, transno 4294967301 00000100:00100000:1.0:1790096837.443160:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324119936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790096837.444082:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1790096837.444193:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff129880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324120064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790096837.444288:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096837.444338:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096837.444355:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120064 00000100:00100000:2.0:1790096837.444367:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120064 00000100:00100000:2.0:1790096837.444599:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096837.444613:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324120064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096837.444926:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5855:x1877052324120064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 316us (637us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790096837.444935:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790096837.445268:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff129880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324120064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790096837.445364:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790096837.445500:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445600:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445609:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445616:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.445621:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445631:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445668:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:1.0:1790096837.445672:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790096837.445679:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.445686:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6014 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790096837.446290:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790096837.446451:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1790096837.446467:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367016831541ns, next at 368016828492ns, rc = 0 00000001:00080000:1.0:1790096837.446476:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1790096837.446540:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7aa00) 00010000:00010000:1.0:1790096837.446545:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790096837.446569:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab5fff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821043 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.446838:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+45:10526:x1877052305228672:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 26348us (26637us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1790096837.446852:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000020:00080000:1.0:1790096837.446858:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790096837.452060:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.452380:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305228928 00000100:00100000:2.0:1790096837.452396:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305228928 00000100:00100000:2.0:1790096837.452489:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:2.0:1790096837.452515:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+45:10526:x1877052305228928:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096837.452556:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096837.452592:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab601b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382104a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.452987:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab601b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382104a expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.453008:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab601b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382104a expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.453030:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096837.453034:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096837.453039:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9c00, rc 0) 00000100:00100000:2.0:1790096837.453130:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+46:10526:x1877052305228928:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 629us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.453156:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:2.0:1790096837.457467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.457597:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305229184 00000100:00100000:1.0:1790096837.457611:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305229184 00000100:00100000:1.0:1790096837.457964:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790096837.457981:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+46:10526:x1877052305229184:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790096837.458302:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10526:x1877052305229184:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 325us (847us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790096837.458310:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790096837.501046:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324120192:0@lo:400:kworker.0 00000100:00100000:0.0:1790096837.501164:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096837.501299:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324120448:0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.501344:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096837.501423:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096837.501429:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324120576:0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.501458:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096837.501540:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120448 00000100:00100000:1.0:1790096837.501550:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120448 00000100:00100000:1.0:1790096837.501685:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790096837.501697:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.501772:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324120448:12345-0@lo:400:kworker.0 Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.501790:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790096837.501842:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324120448:0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.501902:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120576 00000100:00100000:1.0:1790096837.501906:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120576 00000100:00100000:1.0:1790096837.501938:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790096837.501945:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.501980:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324120576:12345-0@lo:400:kworker.0 Request processed in 36us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.501987:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790096837.502010:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324120576:0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502568:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324120320:0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502615:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096837.502700:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096837.502707:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324120704:0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502732:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096837.502775:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120320 00000100:00100000:2.0:1790096837.502789:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120320 00000100:00100000:2.0:1790096837.502824:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120704 00000100:00100000:2.0:1790096837.502827:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120704 00000100:00100000:2.0:1790096837.502850:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790096837.502857:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324120320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502898:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324120320:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.502905:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790096837.502919:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790096837.502925:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324120704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502948:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324120704:12345-0@lo:400:kworker.0 Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.502954:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790096837.502985:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324120704:0@lo:400:kworker.0 00000100:00100000:2.0:1790096837.502995:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324120320:0@lo:400:kworker.0 00000100:00080000:2.0:1790096837.503035:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096837.503042:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096837.506065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324120192 00000100:00100000:3.0:1790096837.506738:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324120192 00000100:00100000:3.0:1790096837.506984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790096837.506999:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324120192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096837.507223:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324120192:12345-0@lo:400:kworker.0 Request processed in 227us (6058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096837.507232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1790096837.507348:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324120192:0@lo:400:kworker.0 00000100:00100000:1.0:1790096837.554984:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.555164:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305229312 00000100:00100000:0.0:1790096837.555178:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305229312 00000100:00100000:0.0:1790096837.555263:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:0.0:1790096837.555274:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10536:x1877052305229312:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790096837.555894:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.555918:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.555934:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.555978:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.555987:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.555994:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556134:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556143:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556150:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096837.556207:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556223:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556229:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556237:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556244:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.556249:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556266:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556282:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096837.556286:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.556292:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556299:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556315:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556847:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556854:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556860:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.556863:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556870:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556880:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac3cb7a00) 00010000:00010000:0.0:1790096837.556883:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.556886:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556905:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556928:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556935:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556941:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556947:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.556950:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556956:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556964:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.556967:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.556970:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.556976:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.557586:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10536:x1877052305229312:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 2305us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096837.557599:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:2.0:1790096837.629996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.630132:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305229568 00000100:00100000:1.0:1790096837.630147:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305229568 00000100:00100000:1.0:1790096837.630230:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:1.0:1790096837.630244:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+47:10539:x1877052305229568:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096837.630284:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096837.630313:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab6037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821051 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630438:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630456:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630471:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630489:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630517:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630524:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630738:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630749:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630756:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096837.630767:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790096837.630914:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630922:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630929:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630936:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.630941:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630948:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630971:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096837.630975:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096837.630981:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.630987:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab603e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631001:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631006:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631011:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631016:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.631019:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631024:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631031:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7500) 00010000:00010000:1.0:1790096837.631033:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096837.631035:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631040:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab6045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631102:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab6037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 50 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631118:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 49 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.631124:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.631126:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096837.631128:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b000, rc 0) 00000100:00100000:1.0:1790096837.631216:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10539:x1877052305229568:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 975us (1237us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1790096837.631225:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:3.0:1790096837.637824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.638209:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305229696 00000100:00100000:1.0:1790096837.638229:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305229696 00000100:00100000:1.0:1790096837.638325:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:1.0:1790096837.638337:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10539:x1877052305229696:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1790096837.638448:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638471:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638487:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638524:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638556:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638564:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638571:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.638577:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638586:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638601:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.638605:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790096837.638611:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.638616:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab605a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.638770:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10539:x1877052305229696:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 434us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.638778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:1.0:1790096837.643982:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.644103:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305229952 00000100:00100000:0.0:1790096837.644120:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305229952 00000100:00100000:0.0:1790096837.644205:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1790096837.644235:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+49:10539:x1877052305229952:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096837.644747:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10539:x1877052305229952:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 528us (777us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790096837.644759:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790096837.724136:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.728133:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305230208 00000100:00100000:0.0:1790096837.728148:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305230208 00000100:00100000:0.0:1790096837.729131:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1790096837.729148:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10548:x1877052305230208:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096837.729185:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096837.729188:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790096837.729227:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab5fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821035 expref: 50 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729245:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096837.729250:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096837.729264:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6061 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821058 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729363:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729378:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 50 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729386:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729440:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 50 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.729466:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 50 pid: 7513 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.729479:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324120832:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096837.729596:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb4af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096837.738396:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.738600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305230336 00000100:00100000:1.0:1790096837.738610:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305230336 00010000:00010000:1.0:1790096837.738688:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 51 pid: 7513 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.738745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1790096837.738756:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+51:2362:x1877052305230336:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096837.738775:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096837.738792:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 51 pid: 7513 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.738806:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 51 pid: 7513 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.738827:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.738832:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.738841:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.738848:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.738866:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096837.738918:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+51:2362:x1877052305230336:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 163us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.738925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00010000:00010000:0.0:1790096837.742892:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab604c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821051 expref: 50 pid: 7513 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.742915:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8484:1877052324120832:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096837.742943:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.742953:0:8484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.742959:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096837.742980:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790096837.743132:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab6061 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 51 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.743148:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 50 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.743175:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.743178:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096837.743182:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690c00, rc 0) 00000100:00100000:0.0:1790096837.743268:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10548:x1877052305230208:12345-192.168.203.11@tcp:101:bash.0 Request processed in 14125us (19146us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1790096837.743277:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:3.0:1790096837.745576:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.745766:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305230592 00000100:00100000:2.0:1790096837.745775:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305230592 00000100:00100000:2.0:1790096837.745845:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1790096837.745855:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+50:10548:x1877052305230592:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1790096837.746121:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.746138:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.746150:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096837.746569:0:5853:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1790096837.746601:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba71c6f2 reply state 00000000d6536844 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.746612:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096837.747125:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10548:x1877052305230592:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1268us (1555us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790096837.747135:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000020:00080000:2.0:1790096837.747140:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790096837.751825:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751843:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751850:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751856:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096837.751861:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751869:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751885:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.751888:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096837.751892:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.751896:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6076 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.755735:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.755954:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305230720 00000100:00100000:2.0:1790096837.755970:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305230720 00000100:00100000:2.0:1790096837.756053:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:2.0:1790096837.756065:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10548:x1877052305230720:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096837.756091:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096837.756126:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab607d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382105f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.756232:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.756246:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 53 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.756256:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.756288:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 53 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.756301:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 53 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096837.756313:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324120960:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096837.756403:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142240 going to sleep for 11 seconds 00000100:00100000:2.0:1790096837.759474:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324120960:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096837.759518:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.760831:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.760984:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305230848 00000100:00100000:1.0:1790096837.760999:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305230848 00010000:00010000:1.0:1790096837.761059:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 54 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.761174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790096837.761186:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:2362:x1877052305230848:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096837.761206:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096837.761216:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 54 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761230:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 54 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761259:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab6068 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821058 expref: 54 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761279:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.761285:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761296:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761306:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.761341:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096837.761431:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+53:2362:x1877052305230848:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 246us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.761441:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00010000:00010000:2.0:1790096837.761985:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.761998:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096837.762075:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790096837.762081:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096837.762109:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.762150:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab607d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.762171:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.762180:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096837.762184:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096837.762187:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096837.762249:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10548:x1877052305230720:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6186us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.762258:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1790096837.766093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.766174:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231104 00000100:00100000:1.0:1790096837.766202:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231104 00000100:00100000:1.0:1790096837.766260:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1790096837.766268:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+52:10548:x1877052305231104:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1790096837.781473:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10548:x1877052305231104:12345-192.168.203.11@tcp:35:bash.0 Request processed in 15195us (15382us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790096837.781487:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790096837.803420:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.803467:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.803514:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.803554:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.803585:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231360 00000100:00100000:0.0:1790096837.803594:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231360 00000100:00100000:3.0:1790096837.803598:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231232 00000100:00100000:3.0:1790096837.803606:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231232 00000100:00100000:3.0:1790096837.803678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1790096837.803685:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231488 00000100:00100000:0.0:1790096837.803690:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231488 00000100:00100000:3.0:1790096837.803691:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305231232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096837.803717:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1790096837.803726:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305231360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096837.803768:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305231232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096837.803776:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1790096837.803787:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305231360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096837.803802:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1790096837.803824:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:0.0:1790096837.803833:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305231488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096837.803861:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305231488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096837.803868:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:2.0:1790096837.804183:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231616 00000100:00100000:2.0:1790096837.804188:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231616 00000100:00100000:2.0:1790096837.804250:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:2.0:1790096837.804258:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305231616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096837.804299:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305231616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.804305:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00080000:3.0:1790096837.804342:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096837.844083:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.844141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231744 00000100:00100000:2.0:1790096837.844151:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231744 00000100:00100000:2.0:1790096837.844243:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:2.0:1790096837.844254:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+53:10555:x1877052305231744:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096837.844280:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096837.844300:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab608b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821066 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844364:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844377:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844387:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096837.844420:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790096837.844425:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096837.844441:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844483:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab608b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821066 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844501:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821066 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.844510:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096837.844513:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096837.844516:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9e00, rc 0) 00000100:00100000:2.0:1790096837.844578:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305231744:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 326us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.844591:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1790096837.863892:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.864059:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305231872 00000100:00100000:1.0:1790096837.864069:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305231872 00000100:00100000:1.0:1790096837.864127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:1.0:1790096837.864138:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305231872:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096837.864160:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096837.864184:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab6099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382106d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864267:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864281:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864293:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864309:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864316:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864322:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864437:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864453:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096837.864489:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790096837.864494:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096837.864515:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864525:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864533:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864540:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864546:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864551:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.864555:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864562:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864581:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:1.0:1790096837.864583:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096837.864589:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864595:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864615:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864621:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.864627:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096837.864629:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865070:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865080:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7500) 00010000:00010000:1.0:1790096837.865083:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096837.865086:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865092:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865141:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac1538800/0xcc97d9eae5ab6099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865157:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.865165:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.865167:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096837.865169:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a800, rc 0) 00000100:00100000:1.0:1790096837.866999:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10555:x1877052305231872:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1642us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.867011:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:3.0:1790096837.875698:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.875771:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232128 00000100:00100000:1.0:1790096837.875789:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232128 00000100:00100000:1.0:1790096837.875850:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:1.0:1790096837.875860:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10555:x1877052305232128:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096837.875878:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096837.875896:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821074 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876002:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876018:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876028:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876050:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876086:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876100:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.876113:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324121088:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096837.876236:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.876246:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 56 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096837.876255:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff129500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324121216:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096837.876293:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3201840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096837.876482:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.876611:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232256 00000100:00100000:3.0:1790096837.876617:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232256 00010000:00010000:3.0:1790096837.876664:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.876695:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1790096837.876703:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+57:2362:x1877052305232256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096837.876713:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096837.876719:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.876730:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.876748:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096837.876753:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.876769:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.876776:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096837.876827:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+57:2362:x1877052305232256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 124us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096837.876835:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1790096837.882406:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096837.883001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232384 00000100:00100000:3.0:1790096837.883011:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232384 00010000:00010000:3.0:1790096837.883056:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096837.883109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:3.0:1790096837.883118:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+57:2363:x1877052305232384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096837.883132:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096837.883139:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.883152:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 57 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.883186:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096837.883192:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.883202:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.883230:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096837.883251:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096837.883317:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+57:2363:x1877052305232384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096837.883326:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:0.0:1790096837.886098:0:5851:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.11@tcp) returned -22 from blocking AST (req@00000000dd4bf350 x1877052324121088) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.886122:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab60ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382106d expref: 56 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.886164:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324121088:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096837.886184:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab6084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382105f expref: 55 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096837.886194:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff129500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324121216:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096837.886231:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.886239:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.886248:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.886253:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096837.886285:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790096837.886436:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab60b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.886451:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.886459:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.886462:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096837.886465:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17b000, rc 0) 00000100:00100000:0.0:1790096837.886526:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10555:x1877052305232128:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 10666us (10836us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1790096837.886541:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1790096837.893070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096837.893160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232640 00000100:00100000:1.0:1790096837.893170:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232640 00000100:00100000:1.0:1790096837.893240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790096837.893250:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10555:x1877052305232640:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:1.0:1790096837.893275:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096837.893300:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab601b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382104a expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096837.893333:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:1.0:1790096837.893338:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096837.893399:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305232640:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096837.893406:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790096837.909903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096837.910177:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232768 00000100:00100000:2.0:1790096837.910214:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232768 00000100:00100000:2.0:1790096837.910539:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:2.0:1790096837.910551:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305232768:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:2.0:1790096837.910705:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.910728:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096837.910743:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790096837.910960:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790096837.911060:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305232768:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 511us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096837.911069:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:3.0:1790096837.928133:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096837.928696:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305232896 00000100:00100000:0.0:1790096837.928707:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305232896 00000100:00100000:0.0:1790096837.928838:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:0.0:1790096837.928849:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+54:10555:x1877052305232896:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096837.928869:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096837.928890:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382107b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.928946:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.928958:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.928989:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.929004:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.929017:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096837.929021:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790096837.929025:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096837.929033:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690400, rc 0) 00000100:00100000:0.0:1790096837.929118:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10555:x1877052305232896:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 271us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096837.929127:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1790096838.013424:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324121344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096838.013507:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096838.014059:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324121344 00000100:00100000:1.0:1790096838.014068:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324121344 00000100:00100000:1.0:1790096838.014124:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790096838.014136:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324121344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096838.014159:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096838.014216:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324121344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.014223:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790096838.014358:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324121344:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1790096838.076944:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096838.076955:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096838.076992:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790096838.076998:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096838.077160:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb156300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324121472:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790096838.077287:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096838.085571:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.085682:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305233024 00000100:00100000:0.0:1790096838.085692:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305233024 00000100:00100000:0.0:1790096838.085762:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1790096838.085774:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233024:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790096838.085819:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790096838.085936:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233024:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096838.085944:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:2.0:1790096838.086555:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb156300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324121472:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790096838.091772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.091932:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305233152 00000100:00100000:2.0:1790096838.091944:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305233152 00000100:00100000:2.0:1790096838.092066:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1790096838.092079:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10556:x1877052305233152:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790096838.092156:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092175:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092187:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092203:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092210:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092217:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092239:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092248:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092254:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096838.092307:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790096838.092311:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096838.092325:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092337:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092344:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092351:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092358:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096838.092362:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092370:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092382:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096838.092385:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096838.092390:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092396:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab60d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092409:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092429:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092435:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092441:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096838.092444:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092466:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092474:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9eaac4e7a800) 00010000:00010000:2.0:1790096838.092477:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096838.092480:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092495:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab60df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092511:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092517:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092523:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092527:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096838.092536:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092555:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092565:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096838.092568:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096838.092571:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.092577:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab60e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.092717:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10556:x1877052305233152:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 640us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.092726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:1.0:1790096838.096393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.096563:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305233408 00000100:00100000:0.0:1790096838.096578:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305233408 00000100:00100000:0.0:1790096838.096884:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:0.0:1790096838.096898:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+55:10556:x1877052305233408:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.096919:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096838.096946:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab60ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821082 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097050:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097066:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097078:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096838.097108:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790096838.097205:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097213:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097220:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097226:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096838.097230:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097238:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097249:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096838.097253:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790096838.097257:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097263:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab60f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097445:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab60ed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821082 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097458:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:0.0:1790096838.097460:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096838.097472:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab60ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821082 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.097482:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096838.097591:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233408:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 697us (1212us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1790096838.097599:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1790096838.107580:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.108079:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305233536 00000100:00100000:2.0:1790096838.108088:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305233536 00000100:00100000:2.0:1790096838.108185:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790096838.108196:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233536:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790096838.108233:0:8484:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790096838.108351:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233536:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 156us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.108359:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790096838.117522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096838.117619:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305233792 00000100:00100000:3.0:1790096838.117629:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305233792 00000100:00100000:3.0:1790096838.117728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:3.0:1790096838.117739:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305233792:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096838.117761:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096838.117764:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790096838.117800:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821066 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.117820:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:3.0:1790096838.117825:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096838.117838:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6102 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821089 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790096838.118243:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790096838.118464:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.118480:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.118491:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.118541:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821089 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.118557:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821089 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.118565:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096838.118568:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096838.118571:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7200, rc 0) 00000100:00100000:3.0:1790096838.118629:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+57:10556:x1877052305233792:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 892us (1116us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1790096838.118658:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790096838.126918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.127183:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234048 00000100:00100000:0.0:1790096838.127195:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234048 00000100:00100000:0.0:1790096838.127262:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1790096838.127284:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+57:10556:x1877052305234048:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.127342:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096838.127370:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821089 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127389:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096838.127400:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096838.127422:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127457:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127473:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127480:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127501:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127564:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127572:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127578:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127594:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096838.127599:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127608:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127616:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:0.0:1790096838.127619:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096838.127623:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127629:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6117 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127961:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127968:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127982:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127988:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096838.127991:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.127997:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.128006:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa3e4a98b (ffff9eaac3cb7a00) 00010000:00010000:0.0:1790096838.128008:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096838.128012:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.128018:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab611e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa3e4a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096838.128116:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305234048:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 834us (1207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096838.128131:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1790096838.132988:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096838.133080:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234176 00000100:00100000:3.0:1790096838.133090:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234176 00000100:00100000:3.0:1790096838.133151:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:3.0:1790096838.133162:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+56:10556:x1877052305234176:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096838.133181:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096838.133204:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6125 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821090 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133261:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133274:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133286:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133383:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 58 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133400:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 57 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.133408:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096838.133411:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790096838.133415:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6600, rc 0) 00000100:00100000:3.0:1790096838.133474:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+57:10556:x1877052305234176:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 314us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096838.133483:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:1.0:1790096838.139256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.139359:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234432 00000100:00100000:0.0:1790096838.139371:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234432 00000100:00100000:0.0:1790096838.139447:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1790096838.139458:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+57:10556:x1877052305234432:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.139539:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.139574:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.139596:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096838.140187:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1790096838.140198:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367710562061ns, next at 368710559941ns, rc = 0 00000004:00010000:0.0:1790096838.140543:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd4bf350 reply state 00000000c745dd2f transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096838.140554:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096838.140675:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+59:10556:x1877052305234432:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1217us (1428us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790096838.140683:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1790096838.146608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.147270:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234560 00000100:00100000:2.0:1790096838.147282:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234560 00000100:00100000:2.0:1790096838.147349:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1790096838.147359:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+59:10556:x1877052305234560:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096838.147399:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096838.147420:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821097 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.147482:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 60 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.147497:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 60 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.147518:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096838.147522:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096838.147527:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8400, rc 0) 00000100:00100000:2.0:1790096838.147597:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+60:10556:x1877052305234560:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 239us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.147604:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00010000:00010000:0.0:1790096838.147934:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.147943:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.147950:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.147958:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096838.147963:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.147971:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.147997:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096838.148000:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790096838.148004:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.148011:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6133 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.152376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.152459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234688 00000100:00100000:0.0:1790096838.152469:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234688 00000100:00100000:0.0:1790096838.152545:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096838.152556:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305234688:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790096838.153216:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096838.153613:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2362:x1877052305234688:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 1055us (1243us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790096838.153622:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790096838.157215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.157318:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305234944 00000100:00100000:0.0:1790096838.157328:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305234944 00000100:00100000:0.0:1790096838.157384:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1790096838.157394:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+59:10556:x1877052305234944:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790096838.157687:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:10556:x1877052305234944:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 294us (479us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790096838.157695:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790096838.159720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.159859:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235200 00000100:00100000:2.0:1790096838.159869:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235200 00000100:00100000:2.0:1790096838.159921:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1790096838.159928:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+60:10556:x1877052305235200:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790096838.160026:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+60:10556:x1877052305235200:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.160033:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:3.0:1790096838.164454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.164830:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235328 00000100:00100000:0.0:1790096838.164841:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235328 00000100:00100000:0.0:1790096838.164898:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1790096838.164908:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:10556:x1877052305235328:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.164943:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096838.164962:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382109e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165196:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165211:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165223:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096838.165258:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096838.165275:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165301:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382109e expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165318:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382109e expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.165326:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096838.165328:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790096838.165332:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:0.0:1790096838.165394:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+61:10556:x1877052305235328:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 487us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096838.165401:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790096838.169049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.169145:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235456 00000100:00100000:0.0:1790096838.169155:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235456 00000100:00100000:0.0:1790096838.169202:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1790096838.169211:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305235456:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.169228:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096838.169249:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210a5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096838.169275:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2b5c6, blocks: 0x1 00010000:00010000:0.0:1790096838.169293:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1790096838.169297:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096838.169306:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.169325:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.169337:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691000, rc 0) 00000100:00100000:0.0:1790096838.169438:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2363:x1877052305235456:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 227us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096838.169445:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1790096838.178750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.179070:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235712 00000100:00100000:0.0:1790096838.179081:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235712 00000100:00100000:0.0:1790096838.179132:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:0.0:1790096838.179142:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+61:10556:x1877052305235712:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790096838.179252:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+61:10556:x1877052305235712:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 111us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096838.179386:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1790096838.186329:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.187522:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235840 00000100:00100000:1.0:1790096838.187534:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235840 00000100:00100000:0.0:1790096838.187883:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790096838.187897:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:10556:x1877052305235840:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.187917:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096838.187940:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210ac expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.187982:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.187991:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096838.187996:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096838.188000:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.188038:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.188052:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096838.188067:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1877052324121600:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096838.188170:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59de40 going to sleep for 11 seconds 00000100:00100000:3.0:1790096838.194040:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.194339:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1877052324121600:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096838.194395:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.194416:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690200, rc 0) 00000100:00100000:0.0:1790096838.194526:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:10556:x1877052305235840:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 6633us (8209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096838.194536:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1790096838.195041:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305235968 00000100:00100000:1.0:1790096838.195057:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305235968 00010000:00010000:1.0:1790096838.195091:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.195133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790096838.195144:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2362:x1877052305235968:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096838.195159:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096838.195181:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.195196:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.195223:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d85f96/0xcc97d9eae5ab614f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210a5 expref: 11 pid: 6696 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.195240:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096838.195244:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096838.195252:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.195263:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.195300:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.195328:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5836:1877052324121728:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790096838.195386:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3201840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096838.200353:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5836:1877052324121728:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790096838.200381:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096838.200439:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2362:x1877052305235968:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5297us (6408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.200450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1790096838.202918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.203033:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236096 00000100:00100000:0.0:1790096838.203045:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236096 00002000:00100000:0.0:1790096838.203093:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eaaff123800 x1877052305236096/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:154/0 lens 504/0 e 0 to 0 dl 1790096849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790096838.203104:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaff123800 with x1877052305236096 ext(0->12) 00002000:00010000:0.0:1790096838.203109:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaff123800 00000100:00100000:0.0:1790096838.203194:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790096838.203205:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2363:x1877052305236096:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790096838.204240:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+12:2363:x1877052305236096:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 1032us (1329us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790096838.204251:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:0.0:1790096838.204260:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eaaff123800 x1877052305236096/t4294967308(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:154/0 lens 504/448 e 0 to 0 dl 1790096849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790096838.204269:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaff123800 with x1877052305236096 ext(0->12) 00002000:00010000:0.0:1790096838.204274:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaff123800 00000100:00100000:1.0:1790096838.206771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096838.206877:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236224 00000100:00100000:3.0:1790096838.206900:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236224 00000100:00100000:3.0:1790096838.206962:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:3.0:1790096838.206972:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+61:10556:x1877052305236224:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1790096838.210862:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790096838.274016:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:3.0:1790096838.274036:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1790096838.274106:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1790096838.274273:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324121856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790096838.274351:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096838.274468:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324121856 00000100:00100000:2.0:1790096838.274477:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324121856 00000100:00100000:2.0:1790096838.274529:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790096838.274552:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324121856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790096838.274579:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1790096838.274617:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.274661:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 11 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.274670:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790096838.274674:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096838.274679:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.274706:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 11 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.274721:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 11 pid: 7012 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.274733:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb154700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1877052324122112:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096838.274803:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142480 going to sleep for 11 seconds 00000004:00080000:3.0:1790096838.274988:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790096838.275001:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaac3275f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1790096838.275005:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac7ead100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaac556c480 00000020:00080000:3.0:1790096838.275009:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac7eadc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaafb40d400 00000020:00080000:3.0:1790096838.275028:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaad0e29480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1790096838.275031:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac7ead600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaad0e29f00 00000020:00080000:3.0:1790096838.275034:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac7ead500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaafb347800 00000100:00100000:3.0:1790096838.275149:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10556:x1877052305236224:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 68178us (68387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096838.275159:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:2.0:1790096838.277423:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096838.277452:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324122240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790096838.277512:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096838.277557:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324122240 00000100:00100000:2.0:1790096838.277564:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324122240 00000100:00100000:2.0:1790096838.277617:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790096838.277626:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324122240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790096838.277683:0:7012:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1790096838.277715:0:7012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2b5c5, atime: 0x6ab2b5c5, ctime: 0x6ab2b5c5, blocks: 0x1 00010000:00010000:2.0:1790096838.277724:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.277738:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1790096838.277743:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096838.277749:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.277764:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.277785:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.277794:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.277812:0:7012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790096838.278599:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324122240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 973us (1085us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790096838.278608:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1790096838.279254:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096838.279263:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.279284:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096838.279288:0:7651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.279300:0:7651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.279319:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.279327:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.279349:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096838.279351:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096838.279353:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790096838.279390:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaafb155f80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790096838.279398:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324122240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790096838.279976:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096838.279990:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324121984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790096838.280046:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790096838.280148:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1790096838.280317:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790096838.281148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.281216:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.282525:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb154700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1877052324122112:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096838.282554:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.282619:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236480 00000100:00100000:2.0:1790096838.282626:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236480 00010000:00010000:2.0:1790096838.282808:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 12 pid: 7012 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.282956:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790096838.282970:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+12:2363:x1877052305236480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096838.282986:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096838.282993:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 12 pid: 7012 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.283008:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 12 pid: 7012 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.283032:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f149e1a4/0xcc97d9eae5ab5f1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382100b expref: 12 pid: 7012 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.283050:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096838.283054:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096838.283060:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.283071:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.283114:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096838.283169:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2363:x1877052305236480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 202us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096838.283219:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324121984 00000100:00100000:3.0:1790096838.283226:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324121984 00000100:00100000:3.0:1790096838.283255:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236352 00000100:00100000:3.0:1790096838.283259:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236352 00000100:00100000:3.0:1790096838.283274:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790096838.283282:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1877052324121984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790096838.283448:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790096838.283452:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790096838 00002000:00010000:3.0:1790096838.283454:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790096838.283456:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790096838 -> 1790096838 00002000:00010000:3.0:1790096838.283464:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790096838.283519:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1877052324121984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (3472us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790096838.283526:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790096838.283542:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790096838.283550:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+12:2363:x1877052305236352:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790096838.285035:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaee6a4000/2, rc 0, transno 4294967309 00000100:00100000:1.0:1790096838.285047:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324121984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790096838.286221:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00010000:00010000:2.0:1790096838.286261:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286275:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286287:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286294:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286314:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790096838.286903:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1877052324121856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12351us (12550us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790096838.286912:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1790096838.286935:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096838.286942:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286951:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096838.286962:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286971:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286990:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.286998:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab615d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.287016:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096838.287017:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096838.287019:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790096838.287049:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaee6a6d80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790096838.287054:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324121856:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1790096838.328456:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1790096838.328482:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1790096838.328486:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1790096838.328970:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2363:x1877052305236352:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 45414us (47746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.328981:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1790096838.332133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.332222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236736 00000100:00100000:0.0:1790096838.332232:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236736 00000100:00100000:0.0:1790096838.332343:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1790096838.332353:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10556:x1877052305236736:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.332408:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096838.332435:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382109e expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.332465:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096838.332470:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096838.332499:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.332513:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.332524:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096838.332837:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfd07b67 reply state 000000007bbbb1cb transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096838.332847:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096838.332949:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:10556:x1877052305236736:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 597us (826us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1790096838.332957:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00010000:00010000:0.0:1790096838.334678:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.334693:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.334700:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.334720:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096838.334725:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.334734:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.335055:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096838.335059:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096838.335064:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.335071:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab616b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.335556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.335845:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305236864 00000100:00100000:1.0:1790096838.335854:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305236864 00000100:00100000:1.0:1790096838.335911:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790096838.335921:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305236864:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790096838.336127:0:7012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790096838.336131:0:7012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790096838 -> 1790096837 00002000:00010000:1.0:1790096838.336133:0:7012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790096837 00002000:00010000:1.0:1790096838.336136:0:7012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790096838 -> 1790096837 00002000:00010000:1.0:1790096838.336138:0:7012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790096838.336236:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305236864:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 316us (683us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790096838.336244:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790096838.338598:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.338806:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237120 00000100:00100000:1.0:1790096838.338817:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237120 00000100:00100000:1.0:1790096838.338912:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1790096838.338923:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+15:10556:x1877052305237120:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790096838.338998:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.339014:0:7513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.339023:0:7513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.339056:0:7513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.339070:0:7513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 15 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.339105:0:7513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324122368:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096838.339222:0:7513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac32759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096838.342333:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.342410:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237248 00000100:00100000:2.0:1790096838.342419:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237248 00010000:00010000:2.0:1790096838.342458:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.342503:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1790096838.342513:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+16:2362:x1877052305237248:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096838.342527:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096838.342547:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.342560:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.342582:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096838.342587:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.342596:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.342605:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.342625:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096838.342705:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+16:2362:x1877052305237248:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 193us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.342712:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00010000:00010000:1.0:1790096838.342862:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab612c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821090 expref: 15 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.342879:0:7513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324122368:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096838.342899:0:7513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342908:0:7513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342914:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342941:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342948:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342954:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342960:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17aa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096838.342965:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342983:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.342993:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:1.0:1790096838.342996:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790096838.343000:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.343006:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab6172 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.343042:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:10556:x1877052305237120:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 4121us (4453us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790096838.343049:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1790096838.346604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.346766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237376 00000100:00100000:2.0:1790096838.346784:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237376 00000100:00100000:2.0:1790096838.346839:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790096838.346849:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305237376:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790096838.346898:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.346920:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.346948:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096838.346952:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096838.346957:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.346993:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.347006:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 7 pid: 6695 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.347022:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1877052324122496:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096838.347116:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142600 going to sleep for 11 seconds 00000100:00100000:3.0:1790096838.353342:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.353422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237504 00000100:00100000:1.0:1790096838.353431:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237504 00010000:00010000:1.0:1790096838.353483:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 8 pid: 6695 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.353530:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1790096838.353540:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305237504:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096838.353554:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096838.353579:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 8 pid: 6695 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.353594:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 8 pid: 6695 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.353689:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096838.353694:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096838.353700:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.353710:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.353731:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096838.353794:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305237504:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 255us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.353801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00010000:00010000:2.0:1790096838.357863:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ac expref: 7 pid: 6695 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.357887:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1877052324122496:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096838.357910:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360209:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360228:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360274:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360283:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360292:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360323:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096838.360328:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360337:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360357:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.360365:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6179 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096838.360975:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305237376:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 14122us (14376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096838.360987:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:3.0:1790096838.375844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.375921:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237760 00000100:00100000:0.0:1790096838.375932:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237760 00000100:00100000:0.0:1790096838.375992:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1790096838.376002:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:10556:x1877052305237760:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790096838.376081:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376097:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376109:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376354:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376376:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376385:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376416:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.376429:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 15 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096838.376443:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324122624:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096838.376525:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaafb318300 going to sleep for 11 seconds 00000100:00100000:0.0:1790096838.381123:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096838.381225:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305237888 00000100:00100000:2.0:1790096838.381234:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305237888 00010000:00010000:2.0:1790096838.381275:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.381333:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790096838.381343:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+16:2362:x1877052305237888:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096838.381359:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096838.381367:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.381380:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 16 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.381404:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096838.381410:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.381419:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.381428:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.381457:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096838.381525:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+16:2362:x1877052305237888:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 183us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.381533:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00010000:00010000:3.0:1790096838.383120:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab613a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821097 expref: 15 pid: 8484 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096838.383144:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324122624:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096838.383168:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.383178:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.383198:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096838.383369:0:5852:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1790096838.383917:0:5852:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1790096838.383975:0:5852:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1790096838.384060:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1877052324122752:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790096838.384126:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096838.384170:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096838.384246:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324122752 00000100:00100000:2.0:1790096838.384253:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324122752 00000100:00100000:2.0:1790096838.384310:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096838.384320:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1877052324122752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790096838.384466:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1877052324122752:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.384473:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790096838.387804:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1790096838.387817:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1790096838.387842:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaee6a4000, transno 4294967309 00000100:00100000:3.0:1790096838.387869:0:5852:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9eaaee6a6d80 x1877052324121856/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790096854 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096838.387883:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1877052324122752:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1790096838.389748:0:5852:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1790096838.389853:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1877052324122880:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790096838.389923:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096838.389965:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096838.390022:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324122880 00000100:00100000:2.0:1790096838.390030:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324122880 00000100:00100000:2.0:1790096838.390081:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096838.390091:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1877052324122880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790096838.390352:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1877052324122880:12345-0@lo:1000:mdt00_001.0 Request processed in 262us (428us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790096838.390360:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790096838.390967:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1877052324122880:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790096838.391004:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391015:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391023:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391041:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096838.391046:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391916:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391938:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096838.391942:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096838.391947:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391953:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6187 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391987:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391994:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.391999:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.392004:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096838.392007:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.392013:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.392038:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096838.392040:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096838.392048:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.393491:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.393502:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.393553:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096838.393568:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324123008:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790096838.394735:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096838.403916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.403995:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305238016 00000100:00100000:1.0:1790096838.404004:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305238016 00000100:00100000:1.0:1790096838.404065:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1790096838.404075:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10555:x1877052305238016:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:1.0:1790096838.404326:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+19:10555:x1877052305238016:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 251us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.404334:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790096838.404541:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324123008:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790096838.404571:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404592:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab60ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404625:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404676:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404702:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404713:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404720:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404726:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404732:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096838.404736:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404743:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404755:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096838.404758:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096838.404762:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404768:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab618e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404789:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404796:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404885:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404891:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096838.404894:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404900:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404909:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096838.404911:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790096838.404914:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.404920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6180 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096838.405170:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10556:x1877052305237760:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 29168us (29334us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1790096838.405179:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000020:00080000:3.0:1790096838.405183:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790096838.405384:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096838.405389:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096838.405931:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790096838.405940:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790096838.413045:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.413574:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305238272 00000100:00100000:1.0:1790096838.413877:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305238272 00000100:00100000:1.0:1790096838.413999:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:1.0:1790096838.414010:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10555:x1877052305238272:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:1.0:1790096838.414383:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1790096838.414488:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10555:x1877052305238272:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 479us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096838.414504:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:0.0:1790096838.421433:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.424386:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305238528 00000100:00100000:1.0:1790096838.424400:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305238528 00000100:00100000:2.0:1790096838.430421:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790096838.430436:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:10556:x1877052305238528:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790096838.431446:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790096838.431552:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1790096838.433030:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433050:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433065:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433074:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433092:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433098:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.433116:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790096838.433369:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:10556:x1877052305238528:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 2933us (11941us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1790096838.433379:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000020:00080000:2.0:1790096838.433384:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790096838.433966:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096838.433975:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.433983:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096838.433987:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.433995:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.434024:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eaac4e7a800) 00010000:00010000:0.0:1790096838.434027:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790096838.434033:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.434039:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6195 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096838.434056:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096838.434058:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096838.434060:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096838.466541:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096838.466759:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305238656 00000100:00100000:1.0:1790096838.466769:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305238656 00000100:00100000:1.0:1790096838.466853:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1790096838.466864:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+20:10558:x1877052305238656:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096838.466889:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096838.466910:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab619c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210b3 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.466972:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.466987:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467000:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467015:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467024:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467030:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467295:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467314:0:7513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467324:0:7513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467372:0:7513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096838.467387:0:7513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 21 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096838.467401:0:7513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324123136:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096838.467492:0:7513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff707840 going to sleep for 11 seconds 00000100:00100000:3.0:1790096838.474951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096838.475408:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305238912 00000100:00100000:0.0:1790096838.475418:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305238912 00000100:00100000:0.0:1790096838.475487:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1790096838.475498:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+22:5599:x1877052305238912:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790096838.475791:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:5599:x1877052305238912:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 293us (847us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1790096838.475798:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1790096838.479000:0:7513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324123136:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096838.479033:0:7513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096838.480539:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096838.480684:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305239040 00000100:00100000:3.0:1790096838.480694:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305239040 00010000:00010000:3.0:1790096838.480733:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 23 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096838.480784:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790096838.480819:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+23:2363:x1877052305239040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096838.480834:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096838.480841:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 23 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480854:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 23 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480874:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b000/0xcc97d9eae5ab60bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821074 expref: 23 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480890:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096838.480894:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480904:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480912:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096838.480943:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096838.481001:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2363:x1877052305239040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 193us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096838.481008:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00010000:00010000:2.0:1790096838.481404:0:7513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481412:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096838.481465:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790096838.481469:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096838.481490:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481503:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481513:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481520:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481543:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481548:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096838.481552:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481560:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481570:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:2.0:1790096838.481573:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096838.481577:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481583:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b600/0xcc97d9eae5ab61a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481595:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481601:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481606:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481611:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096838.481614:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481629:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481867:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eaac4db7500) 00010000:00010000:2.0:1790096838.481870:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096838.481873:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481879:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a400/0xcc97d9eae5ab61aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481917:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17aa00/0xcc97d9eae5ab619c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210b3 expref: 22 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481930:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210b3 expref: 21 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096838.481937:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096838.481939:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096838.481942:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaafb17a800, rc 0) 00000100:00100000:2.0:1790096838.481988:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10558:x1877052305238656:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 15125us (15464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096838.481995:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00010000:00010000:0.0:1790096839.229678:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790096839.375479:0:12126:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096839.375491:0:12126:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096839.375537:0:12126:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790096839.375543:0:12126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790096839.421887:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096839.421899:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096839.421936:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790096839.421943:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096839.422066:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324123264:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790096839.422194:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096839.428326:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad185bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324123264:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790096839.433705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096839.433794:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305239168 00000100:00100000:0.0:1790096839.433813:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305239168 00000100:00100000:0.0:1790096839.433928:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:0.0:1790096839.433944:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10569:x1877052305239168:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1790096839.433969:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1790096839.433998:0:5852:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790096839.434163:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10569:x1877052305239168:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 222us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096839.434174:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1790096839.444848:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096839.444963:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305239424 00000100:00100000:0.0:1790096839.444980:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305239424 00000100:00100000:0.0:1790096839.445069:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1790096839.445081:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:10569:x1877052305239424:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096839.445269:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096839.445303:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab61b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210ba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096839.445447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab61bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096839.445467:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab61bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096839.445484:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab61bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096839.445512:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790096839.445728:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab61b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ba expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096839.445775:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab61bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ba expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096839.445786:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096839.445790:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096839.445795:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691200, rc 0) 00000100:00100000:0.0:1790096839.445882:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:10569:x1877052305239424:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 802us (1044us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790096839.445914:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1790096839.451053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096839.452012:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305239680 00000100:00100000:2.0:1790096839.452024:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305239680 00000100:00100000:2.0:1790096839.452098:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1790096839.452108:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+23:10569:x1877052305239680:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790096839.452189:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452216:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452229:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452424:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452432:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452439:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452446:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096839.452451:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452458:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452486:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096839.452489:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790096839.452506:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.452514:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab61cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096839.452705:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+24:10569:x1877052305239680:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 597us (1660us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790096839.452714:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1790096839.452893:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096839.452928:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305239808 00000100:00100000:2.0:1790096839.452934:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305239808 00000040:00080000:1.0:1790096839.452950:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096839.452957:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1790096839.452983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1790096839.452992:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:2363:x1877052305239808:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096839.453005:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096839.453022:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab61bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210ba expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096839.453036:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096839.453039:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096839.453078:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:2363:x1877052305239808:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 87us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096839.453086:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000040:00080000:1.0:1790096839.453489:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790096839.453510:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096839.458680:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096839.462385:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240064 00000100:00100000:0.0:1790096839.462403:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240064 00000100:00100000:0.0:1790096839.462908:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790096839.462920:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:10569:x1877052305240064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790096839.465434:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:10569:x1877052305240064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 2507us (6755us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790096839.465448:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00010000:00010000:2.0:1790096840.253338:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096840.576426:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324123392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096840.576506:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096840.579990:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324123392 00000100:00100000:2.0:1790096840.580002:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324123392 00000100:00100000:2.0:1790096840.580949:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790096840.580961:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324123392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096840.580999:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096840.581083:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324123392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096840.581090:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790096840.581150:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324123392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790096840.582572:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1790096841.237472:0:12177:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096841.237481:0:12177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096841.237527:0:12177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790096841.237534:0:12177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790096841.282397:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096841.408971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096841.409019:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240320 00000100:00100000:2.0:1790096841.409030:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240320 00000100:00100000:2.0:1790096841.409099:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:2.0:1790096841.409110:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+24:10591:x1877052305240320:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096841.409135:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096841.409195:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab61d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210c1 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096841.409291:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab61db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096841.409305:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab61db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096841.409316:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab61db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096841.409327:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790096841.409471:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab61d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c1 expref: 27 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096841.409488:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab61db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c1 expref: 26 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096841.409497:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:2.0:1790096841.409499:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790096841.409503:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096841.409560:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+26:10591:x1877052305240320:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 452us (599us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790096841.409567:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00080000:2.0:1790096841.409731:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096841.422935:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096841.422977:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240448 00000100:00100000:0.0:1790096841.422986:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240448 00000100:00100000:0.0:1790096841.423038:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:0.0:1790096841.423048:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+26:10591:x1877052305240448:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790096841.423112:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423130:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423142:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423166:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423174:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423192:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423198:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096841.423202:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423210:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423223:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:0.0:1790096841.423226:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096841.423231:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.423237:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690c00/0xcc97d9eae5ab61e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096841.423306:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+26:10591:x1877052305240448:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 259us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096841.423314:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:2.0:1790096841.543427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096841.546940:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240576 00000100:00100000:0.0:1790096841.546956:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240576 00000100:00100000:0.0:1790096841.547356:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1790096841.547376:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305240576:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1790096841.547396:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096841.547419:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084173151/0xcc97d9eae5ab61f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210c8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096841.547472:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2b5c5, atime: 0x6ab2b5c5, ctime: 0x6ab2b5c5, blocks: 0xb 00010000:00010000:0.0:1790096841.547493:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1790096841.547498:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096841.547509:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084173151/0xcc97d9eae5ab61f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c8 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.547530:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084173151/0xcc97d9eae5ab61f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c8 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096841.547542:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690c00, rc 0) 00000100:00100000:0.0:1790096841.547630:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305240576:12345-192.168.203.11@tcp:101:cat.0 Request processed in 256us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096841.547682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00080000:2.0:1790096841.549863:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096841.560546:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096841.560890:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240704 00000100:00100000:3.0:1790096841.560911:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240704 00002000:00100000:3.0:1790096841.560961:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9eaaee6a6680 x1877052305240704/t0(0) o3->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:157/0 lens 488/0 e 0 to 0 dl 1790096852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096841.560973:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee6a6680 with x1877052305240704 ext(0->4095) 00002000:00010000:3.0:1790096841.560979:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee6a6680 00000100:00100000:3.0:1790096841.561117:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790096841.561127:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305240704:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:3.0:1790096841.561499:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305240704:12345-192.168.203.11@tcp:3:cat.0 Request processed in 373us (962us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790096841.561506:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:3.0:1790096841.561513:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9eaaee6a6680 x1877052305240704/t0(0) o3->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:157/0 lens 488/4536 e 0 to 0 dl 1790096852 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096841.561522:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee6a6680 with x1877052305240704 ext(0->4095) 00002000:00010000:3.0:1790096841.561526:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee6a6680 00000001:00080000:1.0:1790096841.665553:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1790096841.665857:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1790096842.301898:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096842.624183:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096842.624208:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324123776:0@lo:400:kworker.0 00000100:00100000:2.0:1790096842.624280:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096842.624364:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324123904:0@lo:400:kworker.0 00000100:00100000:2.0:1790096842.624413:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096842.624795:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324123648:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.624827:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096842.624849:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324124160:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.624869:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096842.624884:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790096842.624890:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324123520:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.624914:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096842.624931:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324124032:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.624948:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096842.624990:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324123904 00000100:00100000:1.0:1790096842.624997:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324123904 00000100:00100000:1.0:1790096842.625064:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124160 00000100:00100000:1.0:1790096842.625068:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124160 00000100:00100000:1.0:1790096842.625091:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790096842.625100:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324123904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625150:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324123904:12345-0@lo:400:kworker.0 Request processed in 51us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.625156:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790096842.625189:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790096842.625196:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324124160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625228:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324124160:12345-0@lo:400:kworker.0 Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.625233:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790096842.625254:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324123776 00000100:00100000:1.0:1790096842.625258:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324123776 00000100:00100000:1.0:1790096842.625281:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324123648 00000100:00100000:1.0:1790096842.625284:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324123648 00000100:00100000:1.0:1790096842.625298:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124032 00000100:00100000:1.0:1790096842.625300:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124032 00000100:00100000:1.0:1790096842.625313:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790096842.625319:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324123776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625347:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324123776:12345-0@lo:400:kworker.0 Request processed in 29us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.625353:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790096842.625362:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790096842.625367:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324123648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625390:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324123648:12345-0@lo:400:kworker.0 Request processed in 22us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.625395:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790096842.625404:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790096842.625410:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625431:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877052324124032:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.625436:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1790096842.625450:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790096842.625460:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096842.625462:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096842.625589:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1877052324124032:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625601:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324123648:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625609:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790096842.625614:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1790096842.625652:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaafb155f80, transno 4294967304 00000100:00100000:1.0:1790096842.625664:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324124160:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625885:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324123904:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.625896:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324123776:0@lo:400:kworker.0 00000100:00100000:3.0:1790096842.626326:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324123520 00000100:00100000:3.0:1790096842.626332:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324123520 00000100:00100000:3.0:1790096842.626375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1790096842.626382:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324123520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096842.626435:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324123520:12345-0@lo:400:kworker.0 Request processed in 54us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096842.626442:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1790096842.626481:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324123520:0@lo:400:kworker.0 00000100:00100000:1.0:1790096842.927334:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096842.927374:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096842.927399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096842.927419:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096842.927443:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096842.927479:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240960 00000100:00100000:1.0:1790096842.927489:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240960 00000100:00100000:1.0:1790096842.927535:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241344 00000100:00100000:1.0:1790096842.927539:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241344 00000100:00100000:1.0:1790096842.927569:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1790096842.927578:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+26:2363:x1877052305240960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096842.927677:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+26:2363:x1877052305240960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 99us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.927685:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1790096842.927702:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1790096842.927719:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305241344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096842.927759:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2362:x1877052305241344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.927765:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1790096842.927784:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305240832 00000100:00100000:1.0:1790096842.927788:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305240832 00000100:00100000:1.0:1790096842.927812:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:1.0:1790096842.927819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305240832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096842.927841:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305240832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.927847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:1.0:1790096842.927875:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241088 00000100:00100000:1.0:1790096842.927878:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241088 00000100:00100000:1.0:1790096842.927900:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241216 00000100:00100000:1.0:1790096842.927903:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241216 00000100:00100000:1.0:1790096842.927923:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:1.0:1790096842.927930:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305241088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096842.927956:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305241088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.927962:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:1.0:1790096842.927973:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790096842.927979:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305241216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096842.928001:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305241216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096842.928007:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00080000:1.0:1790096842.928039:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096842.928044:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096843.134813:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096843.134836:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096843.134906:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096843.135326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124288 00000100:00100000:2.0:1790096843.135335:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124288 00000100:00100000:2.0:1790096843.135384:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790096843.135395:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324124288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096843.135430:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096843.135971:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324124288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 576us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096843.135989:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790096843.138589:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324124288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096843.325065:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790096843.703730:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1790096843.703773:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1790096843.713862:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1790096843.713906:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1790096843.713924:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1790096843.713944:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaac2ea9f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790096843.713950:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaad5635d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaac2ea9900 00000020:00080000:3.0:1790096843.713953:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaad5635800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaaff2aac00 00000020:00080000:1.0:1790096843.714044:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1790096843.714240:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1790096844.352664:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096845.373253:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096845.700273:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096845.700295:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad03fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790096845.700360:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096845.700498:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124416 00000100:00100000:1.0:1790096845.700513:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124416 00000100:00100000:1.0:1790096845.700623:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790096845.700707:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324124416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096845.700770:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096845.701240:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324124416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 607us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096845.701250:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1790096845.703803:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096845.703859:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1790096845.703868:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaee6a6d80, transno 4294967310 00000004:00080000:3.0:1790096845.703892:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1790096845.703934:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad03fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096846.357589:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096846.357757:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241472 00000100:00100000:2.0:1790096846.357773:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241472 00000100:00100000:2.0:1790096846.357855:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1790096846.357868:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10235:x1877052305241472:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790096846.357985:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10235:x1877052305241472:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096846.357993:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1790096846.362283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096846.362429:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241728 00000100:00100000:0.0:1790096846.362459:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241728 00000100:00100000:1.0:1790096846.362681:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790096846.362696:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+13:10235:x1877052305241728:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00080000:3.0:1790096846.362790:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096846.363173:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:10235:x1877052305241728:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 477us (901us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1790096846.363183:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00010000:00010000:0.0:1790096846.398022:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096847.421890:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790096847.676901:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790096847.676911:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790096847.677201:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1790096847.677208:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096847.740879:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324124544:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.740956:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741003:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324125056:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741029:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741055:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790096847.741060:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324124672:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741080:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741098:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324125184:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741119:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741146:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324124800:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741168:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741202:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096847.741208:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324124928:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741230:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096847.741274:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324125056 00000100:00100000:2.0:1790096847.741295:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324125056 00000100:00100000:2.0:1790096847.741345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124672 00000100:00100000:2.0:1790096847.741349:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124672 00000100:00100000:2.0:1790096847.741366:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124800 00000100:00100000:2.0:1790096847.741381:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124800 00000100:00100000:2.0:1790096847.741400:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790096847.741409:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741461:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324125056:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.741468:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790096847.741487:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790096847.741493:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324124672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741532:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324124672:12345-0@lo:400:kworker.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.741538:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790096847.741549:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790096847.741555:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324124800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741586:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324124800:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.741592:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790096847.741614:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124544 00000100:00100000:2.0:1790096847.741618:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124544 00000100:00100000:2.0:1790096847.741664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1790096847.741670:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324124544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741697:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324124544:12345-0@lo:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.741703:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1790096847.741752:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096847.741780:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324124800:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741806:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324124672:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741814:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324124544:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741822:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324125056:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.741938:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324125184 00000100:00100000:2.0:1790096847.741942:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324125184 00000100:00100000:2.0:1790096847.741969:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324124928 00000100:00100000:2.0:1790096847.741972:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324124928 00000100:00100000:2.0:1790096847.741988:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790096847.741994:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.742028:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324125184:12345-0@lo:400:kworker.0 Request processed in 34us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.742035:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790096847.742046:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790096847.742052:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.742081:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324124928:12345-0@lo:400:kworker.0 Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096847.742088:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1790096847.742109:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790096847.742111:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096847.742125:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324124928:0@lo:400:kworker.0 00000100:00100000:2.0:1790096847.742144:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324125184:0@lo:400:kworker.0 00000100:00100000:2.0:1790096848.046181:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096848.046223:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096848.046291:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241856 00000100:00100000:1.0:1790096848.046303:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241856 00000100:00100000:2.0:1790096848.046327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096848.046355:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:2.0:1790096848.046356:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096848.046366:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305241856:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096848.046379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096848.046420:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242368 00000100:00100000:0.0:1790096848.046430:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242368 00000100:00100000:1.0:1790096848.046432:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305241856:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096848.046444:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1790096848.046473:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305241984 00000100:00100000:0.0:1790096848.046476:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305241984 00000100:00100000:0.0:1790096848.046495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1790096848.046501:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305242368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096848.046533:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305242368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096848.046539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1790096848.046551:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1790096848.046557:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2360:x1877052305241984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096848.046586:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2360:x1877052305241984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096848.046591:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00080000:2.0:1790096848.046782:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096848.046885:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242112 00000100:00100000:3.0:1790096848.046889:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242112 00000100:00100000:3.0:1790096848.046936:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242240 00000100:00100000:3.0:1790096848.046940:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242240 00000100:00100000:3.0:1790096848.046963:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1790096848.046971:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305242112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096848.047000:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305242112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096848.047007:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1790096848.047020:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1790096848.047034:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305242240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096848.047059:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305242240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096848.047066:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00080000:2.0:1790096848.047124:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096848.047128:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096848.255244:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324125312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096848.255318:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096848.255450:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324125312 00000100:00100000:1.0:1790096848.255459:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324125312 00000100:00100000:1.0:1790096848.255521:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790096848.255532:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324125312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096848.255567:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096848.255612:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324125312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096848.255618:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790096848.256159:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324125312:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790096848.417827:0:12379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:07:26 (1790096846) 00010000:00010000:3.0:1790096848.446861:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790096848.813452:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1790096848.813476:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1790096848.813528:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790096848.813538:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1790096849.468810:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096850.137275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096850.137344:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242624 00000100:00100000:2.0:1790096850.137354:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242624 00000100:00100000:2.0:1790096850.137428:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1790096850.137439:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+13:11303:x1877052305242624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096850.137458:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096850.137477:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab61f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210cf expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137542:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137555:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137577:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137630:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137663:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137683:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137932:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab620c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137941:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab620c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.137948:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab620c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096850.137956:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790096850.138086:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138094:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138100:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138105:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096850.138109:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138116:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138127:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaac2c3c400) 00010000:00010000:2.0:1790096850.138130:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096850.138141:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138146:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab61fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138158:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138164:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138169:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138174:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096850.138177:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138182:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138190:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096850.138193:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096850.138196:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138201:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6205 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138684:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab61f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210cf expref: 16 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138735:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab620c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210cf expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096850.138742:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096850.138746:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096850.138749:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8000, rc 0) 00000100:00100000:2.0:1790096850.138820:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11303:x1877052305242624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1383us (1554us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790096850.138830:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00080000:0.0:1790096850.139568:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096850.143518:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096850.143560:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096850.143708:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242880 00000100:00100000:2.0:1790096850.143719:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242880 00000100:00100000:2.0:1790096850.143799:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1790096850.143810:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11303:x1877052305242880:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790096850.143932:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11303:x1877052305242880:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096850.143940:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:3.0:1790096850.145085:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305242752 00000100:00100000:3.0:1790096850.145095:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305242752 00000100:00100000:3.0:1790096850.145147:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790096850.145156:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:2361:x1877052305242752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096850.145168:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096850.145192:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab620c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210cf expref: 15 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096850.145223:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096850.145229:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096850.145275:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2361:x1877052305242752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 120us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096850.145291:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00010000:00010000:2.0:1790096850.493941:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790096850.750404:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096850.750415:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096850.750453:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790096850.750459:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790096850.812958:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324125440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096850.813055:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096850.813189:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324125440 00000100:00100000:1.0:1790096850.813198:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324125440 00000100:00100000:1.0:1790096850.813276:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790096850.813286:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324125440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096850.813323:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790096850.813408:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096850.815542:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324125440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2247us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096850.815557:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790096850.815700:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324125440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096851.516916:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096852.214836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.214944:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243008 00000100:00100000:0.0:1790096852.214954:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243008 00000100:00100000:0.0:1790096852.215031:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1790096852.215043:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:11345:x1877052305243008:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096852.215063:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.215084:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab621a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210d6 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215165:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215179:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215190:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215203:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215210:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215216:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215430:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215438:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215445:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215451:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096852.215455:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215473:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215485:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096852.215488:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096852.215494:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215500:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215513:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215518:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215524:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215529:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096852.215531:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215537:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215543:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eaac3cb7a00) 00010000:00010000:0.0:1790096852.215546:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096852.215548:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215565:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6228 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215595:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab621a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210d6 expref: 15 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215605:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096852.215607:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096852.215611:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab621a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210d6 expref: 15 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.215619:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690600, rc 0) 00000100:00100000:0.0:1790096852.215719:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:11345:x1877052305243008:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 678us (891us total) trans 0 rc 301/301 00000100:00100000:0.0:1790096852.215726:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00080000:2.0:1790096852.215903:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096852.225437:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.225533:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243264 00000100:00100000:0.0:1790096852.225543:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243264 00000100:00100000:0.0:1790096852.225670:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:0.0:1790096852.225696:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+14:11345:x1877052305243264:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:0.0:1790096852.225752:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096852.225779:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab5ba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f16 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.225796:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096852.225805:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096852.226047:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.226066:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.226078:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.226091:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.226096:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.226102:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.227085:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790096852.227099:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227107:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227113:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227118:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096852.227122:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227129:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227153:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096852.227156:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096852.227161:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.227168:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab622f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096852.227186:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006546867c reply state 00000000d2561d88 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.227194:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096852.227312:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11345:x1877052305243264:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1614us (1878us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1790096852.227322:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00010000:00010000:3.0:1790096852.234230:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234269:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234276:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234283:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096852.234287:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234295:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234312:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eaac3cb7200) 00010000:00010000:3.0:1790096852.234315:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096852.234320:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.234326:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6236 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.339944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.340022:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243392 00000100:00100000:0.0:1790096852.340033:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243392 00000100:00100000:0.0:1790096852.340095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:0.0:1790096852.340107:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+14:11353:x1877052305243392:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:0.0:1790096852.340144:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.340167:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab623d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210dd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340230:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340245:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340275:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.340310:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790096852.340313:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096852.340333:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340356:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab623d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210dd expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340374:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210dd expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.340382:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096852.340385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790096852.340388:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690600, rc 0) 00000100:00100000:0.0:1790096852.340456:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11353:x1877052305243392:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 351us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096852.340463:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:2.0:1790096852.412133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.412296:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243520 00000100:00100000:3.0:1790096852.412306:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243520 00000100:00100000:3.0:1790096852.412398:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1790096852.412410:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+15:11359:x1877052305243520:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096852.412431:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096852.412453:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab624b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210e4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412553:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412567:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412586:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412602:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412609:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412616:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412764:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412774:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412781:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096852.412808:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790096852.412812:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096852.412835:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412857:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412863:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412870:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412876:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096852.412880:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412886:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412898:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:3.0:1790096852.412901:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096852.412906:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412912:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412925:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412931:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412937:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412948:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096852.412951:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412957:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412965:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eaac2c3c000) 00010000:00010000:3.0:1790096852.412968:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096852.412971:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.412976:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.413008:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab624b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210e4 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.413022:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210e4 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.413029:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096852.413032:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790096852.413034:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6800, rc 0) 00000100:00100000:3.0:1790096852.413093:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+16:11359:x1877052305243520:12345-192.168.203.11@tcp:101:bash.0 Request processed in 686us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.413101:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1790096852.420272:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.420401:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243776 00000100:00100000:0.0:1790096852.420412:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243776 00000100:00100000:0.0:1790096852.420479:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:0.0:1790096852.420491:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+16:11359:x1877052305243776:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096852.420512:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.420533:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6267 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210eb expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.420743:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.420759:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.420772:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.422195:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.422217:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.422228:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790096852.422883:0:8484:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790096852.423061:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423072:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423081:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423116:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423134:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423141:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423147:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096852.423152:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423160:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423173:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096852.423176:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096852.423180:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423186:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab626e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096852.423200:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dd18807 reply state 000000009239ab9f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.423209:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790096852.423246:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 19 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423261:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 18 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.423279:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096852.423282:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096852.423285:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096852.423363:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11359:x1877052305243776:12345-192.168.203.11@tcp:101:bash.0 Request processed in 2874us (3102us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1790096852.423372:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:0.0:1790096852.433237:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.433335:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305243904 00000100:00100000:3.0:1790096852.433347:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305243904 00000100:00100000:3.0:1790096852.433421:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790096852.433432:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305243904:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096852.433449:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096852.433474:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210f2 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790096852.433503:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790096852.433522:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1790096852.433527:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096852.433537:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.433556:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.433569:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7200, rc 0) 00000100:00100000:3.0:1790096852.433627:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305243904:12345-192.168.203.11@tcp:101:bash.0 Request processed in 197us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.433659:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00010000:00010000:2.0:1790096852.434089:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434116:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434124:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434130:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096852.434135:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434144:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434159:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac3cb7a00) 00010000:00010000:2.0:1790096852.434162:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096852.434167:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.434173:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790096852.434270:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096852.438076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.438176:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305244032 00000100:00100000:0.0:1790096852.438186:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305244032 00000100:00100000:0.0:1790096852.438247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1790096852.438258:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:11359:x1877052305244032:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096852.438276:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.438295:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38210f9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.438329:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.438338:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096852.438343:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096852.438348:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.438389:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.438411:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 7 pid: 6694 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.438425:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324125568:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096852.438521:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59de40 going to sleep for 11 seconds 00000100:00100000:3.0:1790096852.448765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096852.449908:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305244160 00000100:00100000:2.0:1790096852.449920:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305244160 00010000:00010000:2.0:1790096852.449971:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 8 pid: 6694 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.450028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1790096852.450039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305244160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096852.450054:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096852.450090:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 8 pid: 6694 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.450103:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 8 pid: 6694 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.450128:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096852.450133:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096852.450141:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.450151:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.450217:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.450233:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef19500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1877052324125696:192.168.203.11@tcp:105: 00000100:00100000:2.0:1790096852.450323:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac13ee3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790096852.452396:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0179343/0xcc97d9eae5ab628a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f2 expref: 8 pid: 6694 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.452418:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1877052324125568:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096852.452447:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.452461:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096852.452562:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:11359:x1877052305244032:12345-192.168.203.11@tcp:101:bash.0 Request processed in 14305us (14494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096852.452570:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1790096852.462848:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef19500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1877052324125696:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790096852.462893:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096852.462949:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305244160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 12910us (14191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096852.462960:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1790096852.470206:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.470312:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305244416 00000100:00100000:0.0:1790096852.470322:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305244416 00000100:00100000:0.0:1790096852.470379:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1790096852.470389:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11359:x1877052305244416:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790096852.470792:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11359:x1877052305244416:12345-192.168.203.11@tcp:35:bash.0 Request processed in 404us (594us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790096852.470800:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00010000:00010000:3.0:1790096852.540865:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096852.570721:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.570873:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305244672 00000100:00100000:0.0:1790096852.570892:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305244672 00000100:00100000:0.0:1790096852.570950:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1790096852.570960:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11369:x1877052305244672:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096852.570985:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.571005:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6298 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821100 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.571091:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790096852.571199:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6298 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821100 expref: 21 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.571212:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096852.571215:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096852.571220:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6298 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821100 expref: 21 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.571233:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:0.0:1790096852.571497:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11369:x1877052305244672:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 537us (784us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1790096852.571504:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:3.0:1790096852.576389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.576449:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305244928 00000100:00100000:0.0:1790096852.576459:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305244928 00000100:00100000:0.0:1790096852.576529:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790096852.576540:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11369:x1877052305244928:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096852.576827:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:11369:x1877052305244928:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 288us (444us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1790096852.576853:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790096852.664684:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.665172:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245056 00000100:00100000:3.0:1790096852.665183:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245056 00000100:00100000:3.0:1790096852.665252:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:3.0:1790096852.665289:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:11375:x1877052305245056:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096852.665314:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096852.665336:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab62a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821107 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665407:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665423:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665435:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096852.665472:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790096852.665476:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096852.665507:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665536:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab62a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821107 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665554:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821107 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.665562:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096852.665565:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096852.665580:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7a00, rc 0) 00000100:00100000:3.0:1790096852.666104:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+22:11375:x1877052305245056:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 826us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.666126:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:2.0:1790096852.672798:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.672918:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245312 00000100:00100000:0.0:1790096852.672929:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245312 00000100:00100000:0.0:1790096852.672989:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:0.0:1790096852.673000:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+22:11375:x1877052305245312:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096852.673020:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.673041:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab62b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382110e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.673136:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.673151:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.673162:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.673173:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790096852.673295:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab62b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382110e expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.673314:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382110e expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.673323:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096852.673325:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096852.673329:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691200, rc 0) 00000100:00100000:0.0:1790096852.673405:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11375:x1877052305245312:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 406us (614us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790096852.673412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:1.0:1790096852.684937:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096852.684989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.685087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245568 00000100:00100000:3.0:1790096852.685097:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245568 00000100:00100000:3.0:1790096852.685178:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096852.685188:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+24:2361:x1877052305245568:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096852.685205:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096852.685229:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382110e expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.685249:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:3.0:1790096852.685253:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096852.685313:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:2361:x1877052305245568:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 126us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.685320:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790096852.686262:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245696 00000100:00100000:0.0:1790096852.686270:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245696 00000100:00100000:0.0:1790096852.686317:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:0.0:1790096852.686326:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11375:x1877052305245696:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096852.686345:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.686363:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab62c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821115 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.686460:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.686474:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.686486:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.686497:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790096852.686626:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab62c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821115 expref: 26 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.686699:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821115 expref: 25 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.686708:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096852.686711:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790096852.686729:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691400, rc 0) 00000100:00100000:0.0:1790096852.686787:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11375:x1877052305245696:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 462us (1796us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1790096852.686793:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:1.0:1790096852.694563:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.694660:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245824 00000100:00100000:3.0:1790096852.694679:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245824 00000100:00100000:3.0:1790096852.694737:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790096852.694747:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2362:x1877052305245824:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:3.0:1790096852.694791:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.694814:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.694822:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096852.694826:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096852.694844:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.694898:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.694914:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 6 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096852.694929:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877052324125824:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096852.695029:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac96fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096852.698971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096852.699171:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305245952 00000100:00100000:2.0:1790096852.699180:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305245952 00002000:00100000:2.0:1790096852.699230:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eaaeef3c000 x1877052305245952/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:168/0 lens 504/0 e 0 to 0 dl 1790096863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096852.699241:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaeef3c000 with x1877052305245952 ext(0->12) 00010000:00010000:2.0:1790096852.699262:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 7 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.699279:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 7 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096852.699288:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaaeef3c000 00000100:00100000:2.0:1790096852.699326:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790096852.699336:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305245952:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:2.0:1790096852.700020:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2362:x1877052305245952:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 680us (1053us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790096852.700029:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:2.0:1790096852.700037:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eaaeef3c000 x1877052305245952/t4294967305(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:168/0 lens 504/448 e 0 to 0 dl 1790096863 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096852.700045:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaeef3c000 with x1877052305245952 ext(0->12) 00010000:00010000:2.0:1790096852.700050:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.700063:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096852.700070:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaaeef3c000 00000100:00100000:3.0:1790096852.701750:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877052324125824:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096852.701777:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.710727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096852.711829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305246080 00000100:00100000:1.0:1790096852.711843:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305246080 00010000:00010000:1.0:1790096852.711904:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096852.711954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1790096852.711965:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2360:x1877052305246080:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096852.711981:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790096852.712004:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790096852.712008:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790096852 00002000:00010000:1.0:1790096852.712010:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790096852 00002000:00010000:1.0:1790096852.712013:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790096852 00010000:00010000:1.0:1790096852.712019:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.712032:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.712073:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000795e653e/0xcc97d9eae5ab6291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210f9 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.712092:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096852.712096:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096852.712101:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.712111:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.712147:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096852.712224:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305246080:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 261us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096852.712232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00010000:00010000:2.0:1790096852.713041:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713067:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713095:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713103:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713112:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713119:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096852.713123:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713132:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713147:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.713154:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da1c829/0xcc97d9eae5ab62de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.713233:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305245824:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 18485us (18679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.713241:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790096852.719395:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.719936:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305246336 00000100:00100000:0.0:1790096852.719948:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305246336 00000100:00100000:0.0:1790096852.720010:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1790096852.720021:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11375:x1877052305246336:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:0.0:1790096852.720084:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821115 expref: 25 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096852.724846:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1790096852.724938:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1790096852.725446:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1790096852.725494:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.725515:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 29 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.725524:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.725570:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 29 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.725586:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 29 pid: 8484 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.725615:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324125952:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096852.725736:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096852.730749:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324125952:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096852.730783:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.733315:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096852.736839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305246464 00000100:00100000:1.0:1790096852.736856:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305246464 00010000:00010000:1.0:1790096852.736906:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 30 pid: 8484 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096852.736961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1790096852.736971:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+30:2362:x1877052305246464:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096852.736986:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096852.736994:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 30 pid: 8484 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.737027:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 30 pid: 8484 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.738375:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab627c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210eb expref: 30 pid: 8484 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.738396:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096852.738401:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.738410:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.738418:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.738445:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096852.738518:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+29:2362:x1877052305246464:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1548us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096852.738534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00010000:00010000:0.0:1790096852.739131:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.739141:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096852.739261:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1790096852.742439:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1790096852.742597:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324126080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790096852.742742:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096852.742775:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59df00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096852.742892:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126080 00000100:00100000:2.0:1790096852.742902:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126080 00000100:00100000:2.0:1790096852.742972:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790096852.742983:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324126080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096852.743069:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324126080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.743076:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790096852.743685:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324126080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790096852.744213:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1790096852.744279:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324126208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790096852.744323:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096852.744343:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142600 going to sleep for 11 seconds 00000100:00080000:0.0:1790096852.744783:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096852.745478:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126208 00000100:00100000:2.0:1790096852.745490:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126208 00000100:00100000:2.0:1790096852.745555:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096852.745566:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1877052324126208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096852.745838:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5855:x1877052324126208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (1511us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790096852.745846:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790096852.745868:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324126208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790096852.745943:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790096852.745986:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.745996:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.746002:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.746008:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096852.746012:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.746019:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.746033:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096852.746036:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790096852.746040:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096852.746045:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab62e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790096852.746244:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790096852.746352:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1790096852.746363:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382316727727ns, next at 383316725778ns, rc = 0 00000001:00080000:1.0:1790096852.746369:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1790096852.746401:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096852.746404:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790096852.746417:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab62d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821115 expref: 33 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096852.746533:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11375:x1877052305246336:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 26513us (27147us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1790096852.746551:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000020:00080000:1.0:1790096852.746557:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790096852.756944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.757043:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305246592 00000100:00100000:3.0:1790096852.757057:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305246592 00000100:00100000:3.0:1790096852.757129:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:3.0:1790096852.757141:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11375:x1877052305246592:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096852.757168:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096852.757195:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab62ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382111c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.757255:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab62ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382111c expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.757284:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab62ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382111c expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.757304:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096852.757307:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096852.757311:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7200, rc 0) 00000100:00100000:3.0:1790096852.757375:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+33:11375:x1877052305246592:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 236us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.757383:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:0.0:1790096852.767515:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096852.767602:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305246848 00000100:00100000:1.0:1790096852.767612:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305246848 00000100:00100000:1.0:1790096852.767732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1790096852.767742:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+33:11375:x1877052305246848:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790096852.767981:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11375:x1877052305246848:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 239us (477us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1790096852.767989:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790096852.858883:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.858985:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305247104 00000100:00100000:0.0:1790096852.858995:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305247104 00000100:00100000:0.0:1790096852.859058:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:0.0:1790096852.859068:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11385:x1877052305247104:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096852.859091:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096852.859112:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821123 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096852.859216:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790096852.859329:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821123 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.859343:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096852.859346:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096852.859351:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab62f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821123 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.859365:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691200, rc 0) 00000100:00100000:0.0:1790096852.859429:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11385:x1877052305247104:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 362us (555us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1790096852.859436:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:2.0:1790096852.865160:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324126336:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865234:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096852.865289:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324126848:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865317:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096852.865360:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096852.865367:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324126464:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865390:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096852.865418:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324126592:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865438:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096852.865452:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096852.865457:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324126720:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865479:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096852.865507:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126720 00000100:00100000:2.0:1790096852.865514:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126720 00000100:00100000:2.0:1790096852.865575:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790096852.865583:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324126720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865659:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324126720:12345-0@lo:400:kworker.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.865666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790096852.865715:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324126720:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865741:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126848 00000100:00100000:2.0:1790096852.865744:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126848 00000100:00100000:2.0:1790096852.865767:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126464 00000100:00100000:2.0:1790096852.865770:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126464 00000100:00100000:2.0:1790096852.865786:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126592 00000100:00100000:2.0:1790096852.865788:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126592 00000100:00100000:2.0:1790096852.865803:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790096852.865809:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324126848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865845:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877052324126848:12345-0@lo:400:kworker.0 Request processed in 36us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.865851:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790096852.865873:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790096852.865879:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324126464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865908:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324126464:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.865914:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790096852.865925:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790096852.865931:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324126592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.865963:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324126592:12345-0@lo:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.865969:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790096852.865992:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324126592:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.866020:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324126464:0@lo:400:kworker.0 00000100:00100000:2.0:1790096852.866028:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324126848:0@lo:400:kworker.0 00000100:00100000:3.0:1790096852.866181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126336 00000100:00100000:3.0:1790096852.866186:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126336 00000100:00100000:3.0:1790096852.866224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790096852.866230:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324126336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096852.866269:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324126336:12345-0@lo:400:kworker.0 Request processed in 40us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096852.866275:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:0.0:1790096852.866628:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096852.866654:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096852.867137:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324126336:0@lo:400:kworker.0 00000100:00100000:3.0:1790096852.871385:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096852.871482:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305247232 00000100:00100000:2.0:1790096852.871491:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305247232 00000100:00100000:2.0:1790096852.871557:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:2.0:1790096852.871568:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11385:x1877052305247232:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1790096852.871685:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871702:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871714:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871744:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871752:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871759:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871837:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871845:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871852:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790096852.871889:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871901:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871907:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871914:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871920:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096852.871924:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871938:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871950:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096852.871953:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096852.871958:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871963:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871976:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871981:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871986:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871990:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096852.871993:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.871998:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872005:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096852.872008:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096852.872011:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872027:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872042:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872048:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872054:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872058:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096852.872062:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872068:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872076:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096852.872079:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096852.872081:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096852.872087:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab630f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096852.872154:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11385:x1877052305247232:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 586us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096852.872161:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1790096852.875748:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.875889:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305247488 00000100:00100000:0.0:1790096852.875901:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305247488 00000100:00100000:0.0:1790096852.875965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790096852.875974:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11385:x1877052305247488:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096852.876205:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11385:x1877052305247488:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 231us (465us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790096852.876212:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1790096852.920729:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096852.920828:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305247744 00000100:00100000:3.0:1790096852.920838:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305247744 00000100:00100000:3.0:1790096852.920891:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1790096852.920901:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11388:x1877052305247744:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096852.920925:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096852.920958:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382112a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921050:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921064:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921076:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921092:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921099:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921105:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921217:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921225:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921232:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096852.921241:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790096852.921335:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921343:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921354:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921360:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096852.921364:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921370:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921381:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096852.921384:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096852.921388:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921394:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab631d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921407:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921412:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921417:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921422:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096852.921424:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921453:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921461:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac2c3c500) 00010000:00010000:3.0:1790096852.921473:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096852.921476:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921482:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921522:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921534:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096852.921541:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096852.921543:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096852.921545:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6600, rc 0) 00000100:00100000:3.0:1790096852.921607:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11388:x1877052305247744:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 707us (888us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790096852.921615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1790096852.927223:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.927333:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305247872 00000100:00100000:0.0:1790096852.927345:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305247872 00000100:00100000:0.0:1790096852.927411:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:0.0:1790096852.927422:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11388:x1877052305247872:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790096852.927518:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927538:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927562:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927589:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927596:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927602:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927608:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096852.927612:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927620:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927631:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096852.927666:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096852.927680:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096852.927687:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096852.927774:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11388:x1877052305247872:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 354us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096852.927782:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:1.0:1790096852.930749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096852.930888:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248128 00000100:00100000:0.0:1790096852.930897:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248128 00000100:00100000:0.0:1790096852.930954:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096852.930964:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11388:x1877052305248128:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096852.931177:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+39:11388:x1877052305248128:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 214us (436us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790096852.931185:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790096853.160750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096853.160799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096853.160825:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096853.160876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096853.161013:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248256 00000100:00100000:2.0:1790096853.161024:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248256 00000100:00100000:2.0:1790096853.161085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:2.0:1790096853.161094:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305248256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096853.161183:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305248256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096853.161191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:2.0:1790096853.161223:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248384 00000100:00100000:2.0:1790096853.161227:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248384 00000100:00100000:2.0:1790096853.161261:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248512 00000100:00100000:2.0:1790096853.161263:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248512 00000100:00100000:2.0:1790096853.161279:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1790096853.161285:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305248384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096853.161312:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2360:x1877052305248384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096853.161318:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1790096853.161329:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1790096853.161335:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305248512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096853.161360:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305248512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096853.161365:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00080000:0.0:1790096853.161883:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096853.161904:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248640 00000100:00100000:0.0:1790096853.161909:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248640 00000100:00100000:0.0:1790096853.161966:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:0.0:1790096853.161975:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305248640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096853.162021:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305248640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 47us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096853.162027:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00080000:1.0:1790096853.162255:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096853.271721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096853.272512:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305248896 00000100:00100000:0.0:1790096853.272522:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305248896 00000100:00100000:0.0:1790096853.272592:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:0.0:1790096853.272603:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+39:11419:x1877052305248896:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1790096853.272627:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096853.272684:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821131 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.272816:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.272831:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.272842:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096853.272855:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790096853.272990:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821131 expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.273021:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821131 expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.273031:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096853.273034:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096853.273041:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691000, rc 0) 00000100:00100000:0.0:1790096853.273110:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11419:x1877052305248896:12345-192.168.203.11@tcp:101:cat.0 Request processed in 508us (1399us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1790096853.273126:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:0.0:1790096853.279440:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096853.279501:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096853.279656:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305249280 00000100:00100000:2.0:1790096853.279674:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305249280 00000100:00100000:1.0:1790096853.279736:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305249152 00000100:00100000:2.0:1790096853.279738:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790096853.279740:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305249152 00000100:00100000:2.0:1790096853.279748:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+42:2361:x1877052305249280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096853.279762:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096853.279805:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821131 expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.279823:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00000100:00100000:1.0:1790096853.279826:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00010000:00010000:2.0:1790096853.279828:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096853.279833:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11419:x1877052305249152:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:2.0:1790096853.279886:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+41:2361:x1877052305249280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096853.279894:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790096853.280059:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11419:x1877052305249152:12345-192.168.203.11@tcp:35:cat.0 Request processed in 225us (629us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790096853.280066:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790096853.373169:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324126976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096853.373245:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096853.373390:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324126976 00000100:00100000:3.0:1790096853.373400:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324126976 00000100:00100000:3.0:1790096853.373461:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790096853.373471:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324126976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096853.373511:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096853.373576:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324126976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096853.373583:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790096853.373694:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324126976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096853.385510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096853.385725:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305249536 00000100:00100000:2.0:1790096853.385735:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305249536 00000100:00100000:2.0:1790096853.385801:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:2.0:1790096853.385812:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11425:x1877052305249536:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1790096853.385835:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096853.385839:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790096853.385866:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab62ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821107 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.385885:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096853.385890:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096853.385902:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6355 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821138 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.386000:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.386032:0:7513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.386040:0:7513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.386076:0:7513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.386090:0:7513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 41 pid: 5851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096853.386105:0:7513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef19880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324127104:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096853.386221:0:7513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac32759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096853.391049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096853.391191:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305249664 00000100:00100000:3.0:1790096853.391199:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305249664 00010000:00010000:3.0:1790096853.391240:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 42 pid: 5851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096853.391292:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1790096853.391302:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+42:2363:x1877052305249664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096853.391318:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790096853.391318:0:7513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef19880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324127104:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096853.391323:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 42 pid: 5851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.391334:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 42 pid: 5851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.396343:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab632b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382112a expref: 42 pid: 5851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.396370:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096853.396376:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.396385:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.396416:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.400810:0:7513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.400852:0:7513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.400858:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096853.400880:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790096853.401037:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab6355 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 43 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.401058:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 42 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.401067:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096853.401070:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096853.401073:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9400, rc 0) 00000100:00100000:0.0:1790096853.401333:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+42:11425:x1877052305249536:12345-192.168.203.11@tcp:101:dd.0 Request processed in 15521us (15839us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1790096853.401342:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00010000:00010000:3.0:1790096853.401658:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096853.401701:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+41:2363:x1877052305249664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 10399us (10660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096853.401709:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790096853.412106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096853.412293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305249920 00000100:00100000:3.0:1790096853.412305:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305249920 00000100:00100000:3.0:1790096853.412379:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:3.0:1790096853.412390:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11425:x1877052305249920:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:3.0:1790096853.412700:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.412717:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.412729:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096853.412781:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1790096853.412809:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d873d287 reply state 000000006082b341 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096853.412817:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096853.412918:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+44:11425:x1877052305249920:12345-192.168.203.11@tcp:36:dd.0 Request processed in 529us (821us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1790096853.412926:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 154 00000020:00080000:3.0:1790096853.412931:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790096853.416141:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416159:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416166:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416172:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096853.416176:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416206:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416223:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096853.416227:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096853.416231:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.416237:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab636a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.565250:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096853.807158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096853.807336:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305250048 00000100:00100000:0.0:1790096853.807346:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305250048 00000100:00100000:0.0:1790096853.807410:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1790096853.807421:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+43:11439:x1877052305250048:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:0.0:1790096853.807447:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096853.807468:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6371 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382113f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807773:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807800:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807815:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807830:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807837:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807842:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807922:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.807932:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 44 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.808034:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.808083:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 44 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.808108:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 44 pid: 7513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096853.808124:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff107800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324127232:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096853.808263:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790096853.812029:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff107800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324127232:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096853.812060:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096853.814526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096853.815091:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305250304 00000100:00100000:3.0:1790096853.815101:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305250304 00000100:00100000:3.0:1790096853.815160:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790096853.815170:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+45:5599:x1877052305250304:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790096853.815494:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+46:5599:x1877052305250304:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 324us (975us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1790096853.815501:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1790096853.818272:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096853.818359:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305250432 00000100:00100000:2.0:1790096853.818369:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305250432 00010000:00010000:2.0:1790096853.818406:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 46 pid: 7513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096853.818450:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1790096853.818460:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+46:2363:x1877052305250432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096853.818703:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096853.818713:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 46 pid: 7513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818727:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 46 pid: 7513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818771:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab635c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821138 expref: 46 pid: 7513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818786:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096853.818791:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818800:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818808:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096853.818849:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096853.818906:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+45:2363:x1877052305250432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 447us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096853.818914:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00010000:00010000:0.0:1790096853.822060:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822078:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096853.822129:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790096853.822133:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096853.822161:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822177:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822187:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822194:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822220:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822225:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096853.822229:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822237:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822251:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096853.822254:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096853.822259:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822280:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822286:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822291:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822296:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096853.822299:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822314:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822322:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096853.822325:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096853.822329:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822334:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab637f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822378:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6371 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382113f expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822393:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382113f expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.822400:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096853.822402:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096853.822404:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691600, rc 0) 00000100:00100000:0.0:1790096853.822582:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+44:11439:x1877052305250048:12345-192.168.203.11@tcp:101:stat.0 Request processed in 15161us (15431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096853.822591:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1790096853.914360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096853.914395:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305250688 00000100:00100000:0.0:1790096853.914404:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305250688 00000100:00100000:0.0:1790096853.914457:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:0.0:1790096853.914479:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+44:11445:x1877052305250688:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:0.0:1790096853.914555:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096853.914727:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382113f expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.914747:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096853.914751:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096853.915116:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.915130:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096853.915141:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096853.915189:0:7513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1790096853.915212:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7dae43f reply state 0000000086797d38 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096853.915221:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096853.915313:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+46:11445:x1877052305250688:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 846us (961us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1790096853.915321:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000020:00080000:0.0:1790096853.915326:0:7513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790096853.919125:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919141:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919150:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919156:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096853.919161:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919169:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919184:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096853.919187:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096853.919192:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.919198:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab638d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096853.945087:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000004:00080000:0.0:1790096853.945251:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1790096853.946065:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324127360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790096853.946137:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096853.946804:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324127360 00000100:00100000:1.0:1790096853.946813:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324127360 00000100:00100000:1.0:1790096853.946858:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096853.946867:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1877052324127360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790096853.946893:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1790096853.946922:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2b5d4, atime: 0x6ab2b5d4, ctime: 0x6ab2b5d4, blocks: 0x1 00010000:00010000:1.0:1790096853.946930:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096853.947060:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1790096853.947065:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096853.947073:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096853.947089:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096853.947102:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096853.947110:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096853.947148:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096853.947366:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096853.947373:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.947382:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096853.947387:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.947397:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.947414:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.947422:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa7ea8c/0xcc97d9eae5ab6394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096853.947442:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096853.947444:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096853.947446:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790096853.948386:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000020:00080000:0.0:1790096853.948480:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaae6142240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790096853.948486:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaaeefcfa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaae6142d80 00000020:00080000:0.0:1790096853.948489:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaaeefcfe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaafb346000 00000020:00080000:2.0:1790096853.948708:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1790096853.948881:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790096853.953225:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1877052324127360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6352us (7080us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790096853.953240:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1790096853.958010:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaeef3ce00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1790096853.958024:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324127360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790096854.102414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.102698:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305250816 00000100:00100000:2.0:1790096854.102708:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305250816 00000100:00100000:2.0:1790096854.102785:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:2.0:1790096854.102796:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+17:11459:x1877052305250816:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:2.0:1790096854.102819:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096854.102842:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab639b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821146 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.102918:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.102932:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790096854.103027:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790096854.103102:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103120:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103128:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103134:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103412:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103422:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103428:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096854.103461:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1790096854.103466:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096854.103489:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103511:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103519:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103526:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103544:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103551:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096854.103556:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103563:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103576:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096854.103579:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096854.103584:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103590:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab63a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103603:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103610:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103622:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103627:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096854.103630:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103741:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103749:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096854.103752:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096854.103755:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103760:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab63a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103796:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab639b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103808:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.103815:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096854.103816:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096854.103819:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9a00, rc 0) 00000100:00100000:2.0:1790096854.103926:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11459:x1877052305250816:12345-192.168.203.11@tcp:101:stat.0 Request processed in 1132us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.103954:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1790096854.205376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.205473:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305251072 00000100:00100000:0.0:1790096854.205485:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305251072 00000100:00100000:0.0:1790096854.205559:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:0.0:1790096854.205570:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11469:x1877052305251072:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096854.205589:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.205610:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382114d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.205752:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790096854.205866:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382114d expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.206864:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096854.206868:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096854.206947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382114d expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.206964:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691000, rc 0) 00000100:00100000:0.0:1790096854.207088:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaae8d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11469:x1877052305251072:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1518us (1718us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1790096854.207096:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:0.0:1790096854.222436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.222678:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305251328 00000100:00100000:3.0:1790096854.222688:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305251328 00000100:00100000:3.0:1790096854.222757:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790096854.222767:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11469:x1877052305251328:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096854.223189:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11469:x1877052305251328:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 421us (760us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790096854.223197:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790096854.302047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.302786:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305251584 00000100:00100000:0.0:1790096854.302797:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305251584 00000100:00100000:0.0:1790096854.302867:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:0.0:1790096854.302878:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11476:x1877052305251584:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096854.302917:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.302938:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821154 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.303035:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.303049:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.303058:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.303090:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.303103:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 21 pid: 5853 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.303114:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324127488:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096854.303212:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790096854.308164:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.308250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305251712 00000100:00100000:1.0:1790096854.308260:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305251712 00010000:00010000:1.0:1790096854.308311:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 22 pid: 5853 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096854.308358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1790096854.308370:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2362:x1877052305251712:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096854.308386:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096854.308393:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 22 pid: 5853 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.308405:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 22 pid: 5853 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.308427:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:1.0:1790096854.308432:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.308453:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.308463:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.308513:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096854.308577:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2362:x1877052305251712:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 209us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096854.308584:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00010000:00010000:0.0:1790096854.310036:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab63b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821146 expref: 21 pid: 5853 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.310057:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324127488:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096854.310080:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.310106:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.310112:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.310200:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1790096854.310419:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.310436:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.310445:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096854.310448:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096854.310451:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691400, rc 0) 00000100:00100000:0.0:1790096854.310734:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:11476:x1877052305251584:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7857us (8695us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790096854.310743:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:2.0:1790096854.313191:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.313353:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305251968 00000100:00100000:0.0:1790096854.313365:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305251968 00000100:00100000:0.0:1790096854.313691:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:0.0:1790096854.313703:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+21:11476:x1877052305251968:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1790096854.313960:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.313976:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.314001:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096854.314057:0:5853:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1790096854.314081:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d96e5950 reply state 00000000cbdf40a8 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.314090:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096854.315330:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11476:x1877052305251968:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1623us (2216us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790096854.315341:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000020:00080000:0.0:1790096854.315347:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790096854.317877:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317893:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317900:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317907:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096854.317911:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317918:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317933:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096854.317937:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096854.317941:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.317946:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab63da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096854.325806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.325968:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305252096 00000100:00100000:0.0:1790096854.325978:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305252096 00000100:00100000:0.0:1790096854.326039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:0.0:1790096854.326050:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11476:x1877052305252096:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096854.326075:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.326096:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382115b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.326204:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.326219:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.326228:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.326282:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.326295:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 24 pid: 5851 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.326308:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324127616:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096854.326390:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790096854.329482:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324127616:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096854.329511:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096854.331244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.333687:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305252224 00000100:00100000:3.0:1790096854.333701:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305252224 00010000:00010000:3.0:1790096854.334021:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 25 pid: 5851 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096854.334129:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1790096854.334140:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+25:2363:x1877052305252224:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096854.334184:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096854.334192:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 25 pid: 5851 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334205:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 25 pid: 5851 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334228:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691400/0xcc97d9eae5ab63cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821154 expref: 25 pid: 5851 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334244:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096854.334249:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334258:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334267:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.334305:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096854.334379:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+24:2363:x1877052305252224:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 241us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096854.334387:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:1.0:1790096854.334690:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.334698:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096854.334750:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790096854.334755:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096854.334775:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.334804:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab63e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382115b expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.334819:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382115b expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.334827:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:1.0:1790096854.334829:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096854.334832:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:1.0:1790096854.334859:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11476:x1877052305252096:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8811us (9063us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096854.334867:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:2.0:1790096854.340692:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.340844:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305252480 00000100:00100000:1.0:1790096854.340868:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305252480 00000100:00100000:1.0:1790096854.340920:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1790096854.340930:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11476:x1877052305252480:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1790096854.341161:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11476:x1877052305252480:12345-192.168.203.11@tcp:35:bash.0 Request processed in 232us (478us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1790096854.341169:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790096854.447396:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.447494:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305252736 00000100:00100000:0.0:1790096854.447511:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305252736 00000100:00100000:0.0:1790096854.447582:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:0.0:1790096854.447592:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11486:x1877052305252736:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096854.447614:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.447632:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821162 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.447992:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790096854.448107:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821162 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.448120:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:0.0:1790096854.448124:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096854.448143:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821162 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.448158:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096854.448297:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11486:x1877052305252736:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 706us (908us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1790096854.448304:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:2.0:1790096854.453096:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.453155:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305252864 00000100:00100000:0.0:1790096854.453164:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305252864 00000100:00100000:0.0:1790096854.453214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:0.0:1790096854.453224:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11486:x1877052305252864:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790096854.453379:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.453395:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.453407:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.453422:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.453429:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.453436:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454068:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454088:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454096:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096854.454141:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454154:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454161:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454167:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454173:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.454177:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454184:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454196:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096854.454199:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.454204:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454210:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab63fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454230:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454236:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454243:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454249:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.454252:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454258:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454349:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096854.454353:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.454357:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454363:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454377:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454383:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454389:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454402:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.454405:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454412:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454420:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096854.454422:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.454425:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.454430:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab640b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.454630:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11486:x1877052305252864:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1406us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096854.454699:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:2.0:1790096854.458411:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.458864:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305253120 00000100:00100000:1.0:1790096854.458876:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305253120 00000100:00100000:1.0:1790096854.458981:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:1.0:1790096854.458992:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11486:x1877052305253120:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790096854.459250:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11486:x1877052305253120:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 259us (848us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1790096854.459258:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790096854.489464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.489577:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305253376 00000100:00100000:1.0:1790096854.489586:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305253376 00000100:00100000:1.0:1790096854.489674:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:1.0:1790096854.489685:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11489:x1877052305253376:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096854.489708:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096854.489743:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab6412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821169 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489818:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489831:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489843:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489875:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489882:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.489888:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490156:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490161:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096854.490168:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790096854.490231:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490236:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490240:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490244:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096854.490247:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490259:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490278:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:1.0:1790096854.490280:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096854.490283:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490287:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490296:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490299:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490303:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490306:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096854.490307:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490310:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490314:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096854.490315:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096854.490317:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490327:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490357:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab6412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821169 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490366:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821169 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.490370:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:1.0:1790096854.490372:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096854.490373:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f600, rc 0) 00000100:00100000:1.0:1790096854.490428:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11489:x1877052305253376:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 747us (976us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1790096854.490433:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1790096854.497572:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.497618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.497676:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305253504 00000100:00100000:3.0:1790096854.497685:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305253504 00000100:00100000:2.0:1790096854.497879:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305253632 00000100:00100000:2.0:1790096854.497894:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305253632 00000100:00100000:2.0:1790096854.497941:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790096854.497952:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+29:2360:x1877052305253632:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096854.497968:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096854.497993:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821169 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.498012:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:2.0:1790096854.498017:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096854.498076:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+28:2360:x1877052305253632:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 127us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.498083:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1790096854.498175:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:3.0:1790096854.498183:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11489:x1877052305253504:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790096854.498239:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498254:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498275:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498301:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498308:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498315:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498321:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096854.498325:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498333:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498358:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096854.498361:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790096854.498365:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.498371:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096854.498418:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11489:x1877052305253504:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 236us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096854.498425:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:0.0:1790096854.501122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.501210:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305253888 00000100:00100000:3.0:1790096854.501219:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305253888 00000100:00100000:3.0:1790096854.501276:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790096854.501287:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11489:x1877052305253888:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096854.501536:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11489:x1877052305253888:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 250us (423us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790096854.501544:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00010000:00010000:0.0:1790096854.589777:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096854.677711:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.677873:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305254144 00000100:00100000:0.0:1790096854.677885:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305254144 00000100:00100000:0.0:1790096854.677952:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:0.0:1790096854.677962:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11507:x1877052305254144:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1790096854.677988:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.678011:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab643c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821170 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.678128:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6443 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.678141:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.678151:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.678161:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790096854.678264:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab643c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821170 expref: 31 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.678281:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821170 expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.678288:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096854.678291:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790096854.678294:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096854.678353:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11507:x1877052305254144:12345-192.168.203.11@tcp:101:cat.0 Request processed in 394us (653us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1790096854.678360:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:2.0:1790096854.716362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.719068:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305254272 00000100:00100000:0.0:1790096854.719082:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305254272 00000100:00100000:0.0:1790096854.719328:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:0.0:1790096854.719340:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11508:x1877052305254272:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096854.719366:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.719401:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821177 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719490:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719503:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719514:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.719561:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790096854.719565:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096854.719582:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719604:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691000/0xcc97d9eae5ab6451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821177 expref: 32 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719620:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821177 expref: 31 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.719627:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096854.719630:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790096854.719675:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096854.719745:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11508:x1877052305254272:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 407us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096854.719751:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:2.0:1790096854.727882:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.732882:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305254656 00000100:00100000:3.0:1790096854.732897:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305254656 00000100:00100000:3.0:1790096854.732977:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790096854.732987:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11508:x1877052305254656:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096854.733321:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11508:x1877052305254656:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 335us (5446us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1790096854.733329:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790096854.736906:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.737023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305254784 00000100:00100000:1.0:1790096854.737034:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305254784 00000100:00100000:1.0:1790096854.737106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790096854.737115:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11508:x1877052305254784:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:1.0:1790096854.737128:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790096854.737152:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab63e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382115b expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.737175:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821170 expref: 31 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.737204:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab62ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382111c expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.737214:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:1.0:1790096854.737225:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096854.737549:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11508:x1877052305254784:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 434us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096854.737557:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790096854.740327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.740495:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305254912 00000100:00100000:0.0:1790096854.740518:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305254912 00000100:00100000:0.0:1790096854.740579:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:0.0:1790096854.740589:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11508:x1877052305254912:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1790096854.740720:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.740737:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.740748:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096854.741045:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1790096854.741219:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11508:x1877052305254912:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 631us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096854.741228:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:0.0:1790096854.764903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.764987:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255040 00000100:00100000:1.0:1790096854.764997:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255040 00000100:00100000:1.0:1790096854.765060:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:1.0:1790096854.765071:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11510:x1877052305255040:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096854.765091:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096854.765112:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab6466 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382117e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765178:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765192:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765203:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765217:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765241:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765248:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765888:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765899:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765907:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096854.765943:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790096854.765948:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096854.765967:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765980:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765988:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.765995:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766001:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766017:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096854.766021:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766029:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766041:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:1.0:1790096854.766044:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096854.766049:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766054:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab646d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766068:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766073:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766078:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766082:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096854.766084:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766089:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766106:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096854.766108:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096854.766111:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766115:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766148:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fc00/0xcc97d9eae5ab6466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766161:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096854.766169:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096854.766171:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096854.766175:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f800, rc 0) 00000100:00100000:1.0:1790096854.766245:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11510:x1877052305255040:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1175us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096854.766253:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 169 00000040:00080000:1.0:1790096854.844935:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096854.844946:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096854.845001:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1790096854.845009:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790096854.845135:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeef3c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324127744:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790096854.845303:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790096854.869358:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.869975:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255168 00000100:00100000:2.0:1790096854.869985:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255168 00000100:00100000:2.0:1790096854.870047:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:2.0:1790096854.870058:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255168:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790096854.870088:0:7513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790096854.870249:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255168:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 191us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.870258:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:1.0:1790096854.870479:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeef3c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324127744:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790096854.875322:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.875427:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255296 00000100:00100000:0.0:1790096854.875805:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255296 00000100:00100000:0.0:1790096854.875983:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1790096854.875995:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11521:x1877052305255296:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790096854.876065:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876083:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876094:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876157:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876166:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876173:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876202:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876211:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876218:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.876255:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790096854.876260:0:8484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096854.876273:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876283:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876290:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876296:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876312:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.876317:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876325:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876337:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:0.0:1790096854.876340:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.876345:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876352:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6482 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876365:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876370:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876377:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876381:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.876384:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876390:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876407:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096854.876409:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.876412:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876417:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab6489 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.876432:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877022:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877032:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877037:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.877040:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877047:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877057:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096854.877059:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.877063:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.877068:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.877169:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11521:x1877052305255296:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 1174us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096854.877178:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:3.0:1790096854.881162:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096854.881929:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255552 00000100:00100000:1.0:1790096854.881939:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255552 00000100:00100000:0.0:1790096854.882105:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1790096854.882117:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+30:11521:x1877052305255552:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096854.882138:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.882160:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6497 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821185 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882253:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882268:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882279:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096854.882290:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790096854.882390:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882402:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882409:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882415:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.882433:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882497:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882510:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:0.0:1790096854.882514:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790096854.882519:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882525:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab649e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.882631:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6497 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821185 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.883033:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:0.0:1790096854.883036:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096854.883040:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6497 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821185 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.883052:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096854.883121:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255552:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1968us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1790096854.883129:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:2.0:1790096854.892002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.893462:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255680 00000100:00100000:0.0:1790096854.893474:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255680 00000100:00100000:0.0:1790096854.893545:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:0.0:1790096854.893566:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255680:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790096854.893605:0:5853:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790096854.893750:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255680:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 196us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096854.893758:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:1.0:1790096854.897606:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.897809:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305255936 00000100:00100000:0.0:1790096854.897819:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305255936 00000100:00100000:0.0:1790096854.897880:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:0.0:1790096854.897890:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305255936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096854.897909:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096854.897913:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790096854.897940:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821177 expref: 31 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.897957:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096854.897962:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096854.897974:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382118c expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790096854.898826:0:8484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790096854.899083:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab64b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.899097:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab64b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.899107:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab64b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.899180:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382118c expref: 33 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.899195:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab64b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382118c expref: 32 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.899202:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096854.899204:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096854.899207:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691200, rc 0) 00000100:00100000:0.0:1790096854.899288:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11521:x1877052305255936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1399us (1691us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1790096854.899297:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:1.0:1790096854.916198:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096854.916306:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305256192 00000100:00100000:0.0:1790096854.916318:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305256192 00000100:00100000:0.0:1790096854.916378:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1790096854.916390:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11521:x1877052305256192:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096854.916456:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096854.916482:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab64b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382118c expref: 32 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.916502:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096854.916512:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096854.916544:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.917418:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918045:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918070:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918078:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918084:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918295:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918303:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918311:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918317:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.918322:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918328:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918339:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096854.918342:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.918347:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918358:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab64c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918369:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918375:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918380:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918385:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096854.918388:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918394:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918401:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe2c3f3cc (ffff9eaac3cb7a00) 00010000:00010000:0.0:1790096854.918403:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096854.918406:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096854.918411:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab64c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe2c3f3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096854.920481:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305256192:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 4079us (4276us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096854.920493:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1790096854.937214:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.937346:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305256320 00000100:00100000:2.0:1790096854.937356:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305256320 00000100:00100000:2.0:1790096854.937446:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:2.0:1790096854.937468:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11521:x1877052305256320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096854.937487:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096854.937520:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821193 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937562:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937575:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937586:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937732:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937757:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.937766:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096854.937769:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790096854.937773:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9600, rc 0) 00000100:00100000:2.0:1790096854.937828:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11521:x1877052305256320:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 364us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.937835:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:1.0:1790096854.951213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.952971:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305256576 00000100:00100000:2.0:1790096854.952987:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305256576 00000100:00100000:2.0:1790096854.953052:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:2.0:1790096854.953062:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11521:x1877052305256576:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790096854.953143:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.953159:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.953171:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790096854.954180:0:7513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1790096854.954193:0:7513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384524557237ns, next at 385524554437ns, rc = 0 00000004:00010000:2.0:1790096854.954426:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8c7796e reply state 00000000b091720b transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096854.954460:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096854.958067:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11521:x1877052305256576:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 4999us (6853us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1790096854.958078:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00010000:00010000:3.0:1790096854.961070:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961088:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961097:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961103:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096854.961108:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961116:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961131:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:3.0:1790096854.961134:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790096854.961139:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096854.961145:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab64dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096854.962951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.963187:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305256704 00000100:00100000:2.0:1790096854.963197:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305256704 00000100:00100000:2.0:1790096854.963272:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:2.0:1790096854.963282:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+33:11521:x1877052305256704:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096854.963309:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096854.963331:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382119a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.963395:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.963411:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.963432:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096854.963447:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096854.963451:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096854.963784:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11521:x1877052305256704:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 502us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.963792:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:1.0:1790096854.969540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.969877:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305256832 00000100:00100000:2.0:1790096854.969887:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305256832 00000100:00100000:2.0:1790096854.969979:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1790096854.969990:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+6:2361:x1877052305256832:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790096854.970336:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305256832:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 347us (800us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790096854.970344:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790096854.974772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096854.974838:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257088 00000100:00100000:3.0:1790096854.974849:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257088 00000100:00100000:3.0:1790096854.974904:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790096854.974914:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11521:x1877052305257088:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790096854.975143:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11521:x1877052305257088:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 230us (454us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1790096854.975163:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1790096854.979455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.979711:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257344 00000100:00100000:2.0:1790096854.979721:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257344 00000100:00100000:2.0:1790096854.979776:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:2.0:1790096854.979786:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11521:x1877052305257344:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790096854.979882:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11521:x1877052305257344:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 96us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096854.979889:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:1.0:1790096854.998339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096854.999723:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257472 00000100:00100000:2.0:1790096854.999735:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257472 00000100:00100000:2.0:1790096854.999797:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1790096854.999806:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11521:x1877052305257472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096854.999826:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096854.999846:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab64eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211a1 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.999906:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.999920:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096854.999930:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096854.999976:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096854.999992:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.000017:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab64eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a1 expref: 37 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.000034:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a1 expref: 36 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.000043:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096855.000046:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790096855.000049:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8000, rc 0) 00000100:00100000:2.0:1790096855.000106:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11521:x1877052305257472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 302us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096855.000113:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:1.0:1790096855.005750:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096855.005880:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257600 00000100:00100000:0.0:1790096855.005889:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257600 00000100:00100000:0.0:1790096855.005951:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790096855.005961:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305257600:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790096855.005977:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096855.005998:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211a8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096855.006024:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2b5d6, blocks: 0x1 00010000:00010000:0.0:1790096855.006043:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1790096855.006047:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096855.006057:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.006072:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.006085:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096855.006136:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305257600:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 177us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096855.006142:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00080000:1.0:1790096855.006423:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096855.010982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.011825:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257856 00000100:00100000:1.0:1790096855.011839:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257856 00000100:00100000:1.0:1790096855.011894:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1790096855.011903:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11521:x1877052305257856:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790096855.012009:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11521:x1877052305257856:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 107us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096855.012016:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:0.0:1790096855.017918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.018050:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305257984 00000100:00100000:1.0:1790096855.018062:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305257984 00000100:00100000:1.0:1790096855.018117:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790096855.018126:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+8:11521:x1877052305257984:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096855.018142:0:7012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096855.018158:0:7012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211af expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.018206:0:7012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.018215:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096855.018219:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096855.018225:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.018258:0:7012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.018272:0:7012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.018287:0:7012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324127872:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096855.018375:0:7012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a2c300 going to sleep for 11 seconds 00000100:00100000:1.0:1790096855.030679:0:7012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324127872:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096855.030716:0:7012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.030739:0:7012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fc00, rc 0) 00000100:00100000:1.0:1790096855.030793:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+9:11521:x1877052305257984:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 12666us (12882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096855.030802:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1790096855.050610:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.051104:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258112 00000100:00100000:3.0:1790096855.051115:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258112 00010000:00010000:0.0:1790096855.051309:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096855.051407:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790096855.051418:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2360:x1877052305258112:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096855.051436:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096855.051462:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.051478:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.051502:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092fe5373/0xcc97d9eae5ab64f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a8 expref: 9 pid: 6696 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.051519:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096855.051523:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096855.051531:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.051542:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.051586:0:8472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096855.051604:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff107480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8472:1877052324128000:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790096855.052009:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096855.065857:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff107480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8472:1877052324128000:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790096855.065887:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096855.065943:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305258112:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 14526us (15342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096855.065953:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1790096855.068146:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.080827:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258240 00000100:00100000:2.0:1790096855.080844:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258240 00002000:00100000:2.0:1790096855.080902:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eaaee587480 x1877052305258240/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:171/0 lens 504/0 e 0 to 0 dl 1790096866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096855.080914:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee587480 with x1877052305258240 ext(0->8) 00002000:00010000:2.0:1790096855.080933:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee587480 00000100:00100000:2.0:1790096855.080971:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790096855.080981:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305258240:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790096855.083383:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2362:x1877052305258240:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 478us (13321us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790096855.083409:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00002000:00100000:2.0:1790096855.083425:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eaaee587480 x1877052305258240/t4294967314(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:171/0 lens 504/448 e 0 to 0 dl 1790096866 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096855.083435:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee587480 with x1877052305258240 ext(0->8) 00002000:00010000:2.0:1790096855.083442:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee587480 00000100:00100000:1.0:1790096855.086999:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.091785:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258368 00000100:00100000:3.0:1790096855.091799:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258368 00000100:00100000:3.0:1790096855.091858:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:3.0:1790096855.091868:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11521:x1877052305258368:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790096855.147121:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11521:x1877052305258368:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 55245us (60122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.147135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000001:00080000:3.0:1790096855.147170:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:3.0:1790096855.147210:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1790096855.147213:0:12493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790096855.147225:0:12493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1790096855.147232:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000100:00100000:3.0:1790096855.147431:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324128128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790096855.147612:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096855.147692:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324128128 00000100:00100000:3.0:1790096855.147699:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324128128 00000100:00100000:3.0:1790096855.147744:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790096855.147752:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324128128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790096855.147875:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790096855.147879:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790096854 00002000:00010000:3.0:1790096855.147881:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790096855.147883:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790096854 -> 1790096854 00002000:00010000:3.0:1790096855.147885:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790096855.147920:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324128128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (308us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790096855.147926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790096855.147943:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1790096855.147969:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaafb503b80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1790096855.147974:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324128128:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1790096855.148057:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1790096855.148066:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790096855.151701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.151774:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258496 00000100:00100000:2.0:1790096855.151784:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258496 00000100:00100000:2.0:1790096855.151847:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1790096855.151859:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2363:x1877052305258496:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790096855.222661:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1790096855.222684:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1790096855.222780:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305258496:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 70857us (71024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096855.222793:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1790096855.228387:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.236090:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258752 00000100:00100000:1.0:1790096855.236109:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258752 00000100:00100000:1.0:1790096855.236273:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:1.0:1790096855.236284:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11521:x1877052305258752:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790096855.236341:0:8484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096855.236374:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab64f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211a1 expref: 18 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.236391:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:1.0:1790096855.236398:0:8484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096855.236439:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.236466:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.236478:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790096855.236797:0:8484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2c6659a reply state 00000000e1841fff transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.236808:0:8484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790096855.237160:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11521:x1877052305258752:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 877us (8784us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1790096855.237169:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00010000:00010000:2.0:1790096855.243783:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243800:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243808:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243815:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.243820:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243842:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243862:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096855.243874:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.243879:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.243884:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ee00/0xcc97d9eae5ab6507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096855.251113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.251203:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305258880 00000100:00100000:3.0:1790096855.251213:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305258880 00000100:00100000:3.0:1790096855.251278:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1790096855.251288:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305258880:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790096855.251535:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790096855.251539:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790096854 -> 1790096854 00002000:00010000:3.0:1790096855.251541:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790096852 00002000:00010000:3.0:1790096855.251543:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790096854 -> 1790096854 00002000:00010000:3.0:1790096855.251545:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790096855.251602:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305258880:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 314us (497us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790096855.251610:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1790096855.255390:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.255475:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259136 00000100:00100000:3.0:1790096855.255486:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259136 00000100:00100000:3.0:1790096855.255559:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:3.0:1790096855.255570:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11521:x1877052305259136:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790096855.255678:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.255719:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.255729:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.255769:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.255782:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 18 pid: 5853 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.255798:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324128256:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096855.255884:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac96fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1790096855.262371:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324128256:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096855.262404:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.263383:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.263865:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259264 00000100:00100000:3.0:1790096855.263875:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259264 00010000:00010000:3.0:1790096855.263916:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 19 pid: 5853 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.263956:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1790096855.263964:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+19:2363:x1877052305259264:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096855.263979:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096855.263986:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 19 pid: 5853 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.263999:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 19 pid: 5853 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.264038:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab64d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821193 expref: 19 pid: 5853 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.264055:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:3.0:1790096855.264060:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.264068:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.264075:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.264104:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096855.264155:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2363:x1877052305259264:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 191us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.264162:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:0.0:1790096855.264355:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264364:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264395:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264402:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264407:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264413:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096855.264417:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264424:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264455:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:0.0:1790096855.264458:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790096855.264463:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.264469:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab650e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096855.264529:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+17:11521:x1877052305259136:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 8952us (9138us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790096855.264538:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:0.0:1790096855.280606:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096855.280667:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259392 00000100:00100000:0.0:1790096855.280678:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259392 00000100:00100000:0.0:1790096855.280731:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790096855.280742:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2361:x1877052305259392:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790096855.280788:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.280810:0:7012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.280819:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096855.280824:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790096855.280829:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.280881:0:7012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096855.280895:0:7012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 8 pid: 7012 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096855.280911:0:7012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff107100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324128384:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096855.280996:0:7012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096855.290321:0:7012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff107100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324128384:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096855.290350:0:7012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.291265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.291749:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259520 00000100:00100000:3.0:1790096855.291758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259520 00010000:00010000:3.0:1790096855.291800:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.291856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1790096855.291867:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305259520:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096855.291882:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096855.291903:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.291916:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.291939:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4936b8/0xcc97d9eae5ab6500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211af expref: 9 pid: 7012 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.291952:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096855.291955:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096855.291960:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.291969:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.291992:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096855.292045:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305259520:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 179us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.292051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00010000:00010000:3.0:1790096855.292088:0:7012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292098:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292123:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292131:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292139:0:7012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292146:0:7012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096855.292150:0:7012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292158:0:7012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292170:0:7012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.292178:0:7012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.292232:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305259392:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 11492us (11636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.292239:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790096855.303808:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.304400:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259776 00000100:00100000:2.0:1790096855.304410:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259776 00000100:00100000:2.0:1790096855.304474:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:2.0:1790096855.304485:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+17:11521:x1877052305259776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790096855.304588:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304605:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304617:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304829:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304841:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304862:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304897:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.304912:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 18 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.304927:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324128512:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096855.305004:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096855.309054:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.309142:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324128512:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096855.309171:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.309416:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305259904 00000100:00100000:1.0:1790096855.309423:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305259904 00010000:00010000:1.0:1790096855.309459:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 19 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.309494:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1790096855.309503:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+19:2362:x1877052305259904:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096855.309532:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096855.309539:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 19 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309552:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 19 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309575:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab64e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382119a expref: 19 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309591:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:1.0:1790096855.309596:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309606:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309615:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.309669:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096855.309741:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2362:x1877052305259904:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 238us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096855.309749:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00010000:00010000:2.0:1790096855.309855:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.309863:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096855.310053:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1790096855.310194:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1790096855.310235:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790096855.310313:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324128640:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790096855.310360:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096855.310398:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096855.310456:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324128640 00000100:00100000:3.0:1790096855.310461:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324128640 00000100:00100000:3.0:1790096855.310498:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790096855.310506:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1877052324128640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790096855.310578:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1877052324128640:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.310585:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790096855.311129:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1790096855.311137:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaafb503b80, transno 4294967315 00000100:00100000:1.0:1790096855.311188:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324128640:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790096855.311709:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1790096855.311775:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324128768:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790096855.311818:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096855.311844:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00000100:00100000:2.0:1790096855.312720:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324128768 00000100:00100000:2.0:1790096855.312730:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324128768 00000100:00100000:2.0:1790096855.312791:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096855.312801:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1877052324128768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790096855.313053:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1877052324128768:12345-0@lo:1000:mdt00_000.0 Request processed in 252us (1233us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790096855.313060:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096855.313107:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324128768:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790096855.313142:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313152:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313160:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313166:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.313171:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313179:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313194:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7a500) 00010000:00010000:2.0:1790096855.313197:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096855.313202:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313209:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6523 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313237:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313253:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313259:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313264:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.313268:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313274:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313282:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:2.0:1790096855.313285:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096855.313288:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313293:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691a00/0xcc97d9eae5ab645f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313314:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313328:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313338:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313366:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.313386:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 21 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.313399:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324128896:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096855.313498:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096855.317333:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324128896:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096855.317362:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.319208:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.319283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305260032 00000100:00100000:1.0:1790096855.319293:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305260032 00010000:00010000:1.0:1790096855.319336:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 22 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.319379:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:1.0:1790096855.319388:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2363:x1877052305260032:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096855.319404:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096855.319411:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 22 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319424:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 22 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319466:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab647b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382117e expref: 22 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319483:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:1.0:1790096855.319489:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319510:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319518:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.319552:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096855.319600:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:2363:x1877052305260032:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 213us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096855.319608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00010000:00010000:2.0:1790096855.320006:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320016:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320029:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320036:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320043:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320050:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.320055:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320063:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320073:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:2.0:1790096855.320085:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.320090:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320096:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab652a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320109:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320115:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320120:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320125:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.320128:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320133:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320140:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac3cb7000) 00010000:00010000:2.0:1790096855.320142:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790096855.320144:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.320149:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab651c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.320422:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11521:x1877052305259776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 15936us (16621us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1790096855.320441:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000020:00080000:2.0:1790096855.320445:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790096855.320795:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096855.320801:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096855.321405:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790096855.321413:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096855.325420:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.326341:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305260288 00000100:00100000:2.0:1790096855.326355:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305260288 00000100:00100000:2.0:1790096855.327867:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790096855.327888:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11521:x1877052305260288:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790096855.328987:0:5854:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790096855.329094:0:5854:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1790096855.329147:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329164:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329176:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329184:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329190:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329196:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.329225:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790096855.329320:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+22:11521:x1877052305260288:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1440us (3907us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1790096855.329338:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000020:00080000:2.0:1790096855.329344:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790096855.329427:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096855.329434:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.330147:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096855.330154:0:7651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.330175:0:7651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.330189:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eaac4e7ad00) 00010000:00010000:1.0:1790096855.330193:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790096855.330198:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.330204:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.330222:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096855.330224:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096855.330226:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096855.574012:0:12532:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096855.574021:0:12532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096855.574067:0:12532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790096855.574074:0:12532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790096855.618745:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096855.742221:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.742542:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305260544 00000100:00100000:3.0:1790096855.742553:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305260544 00000100:00100000:3.0:1790096855.742608:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1790096855.742617:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+22:11531:x1877052305260544:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096855.742668:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096855.742701:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211b6 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.742798:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab653f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.742812:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab653f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.742831:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab653f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096855.742844:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790096855.742964:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211b6 expref: 25 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.742981:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab653f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211b6 expref: 24 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.742991:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096855.743006:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790096855.743009:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6600, rc 0) 00000100:00100000:3.0:1790096855.743064:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11531:x1877052305260544:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 448us (855us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790096855.743071:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1790096855.751826:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.751935:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305260672 00000100:00100000:3.0:1790096855.751945:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305260672 00000100:00100000:3.0:1790096855.751999:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:3.0:1790096855.752009:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11531:x1877052305260672:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790096855.752083:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752100:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752112:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752136:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752143:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752151:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752361:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752369:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752376:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096855.752413:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752425:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752432:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752439:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752445:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096855.752463:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752479:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752491:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096855.752494:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096855.752499:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752505:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab654d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752516:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752522:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752527:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752532:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096855.752534:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752540:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752546:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096855.752549:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096855.752551:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752567:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752581:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752587:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752592:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752596:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096855.752599:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752605:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752612:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c500) 00010000:00010000:3.0:1790096855.752614:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096855.752617:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.752623:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab655b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.752742:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11531:x1877052305260672:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 733us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.752749:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:3.0:1790096855.801930:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.802087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305260928 00000100:00100000:2.0:1790096855.802099:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305260928 00000100:00100000:2.0:1790096855.802161:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:2.0:1790096855.802172:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+24:11534:x1877052305260928:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096855.802193:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096855.802215:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211bd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802287:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802302:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802313:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802329:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802336:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.802342:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.803054:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.803067:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.803076:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096855.803086:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790096855.803296:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803304:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803312:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803318:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096855.803323:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803331:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803350:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096855.803353:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096855.803358:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803365:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803378:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803384:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803389:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803407:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096855.803411:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803418:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803426:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7a500) 00010000:00010000:3.0:1790096855.803428:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096855.803431:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803629:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803741:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8200/0xcc97d9eae5ab6562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803756:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.803763:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:3.0:1790096855.803765:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096855.803768:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8e00, rc 0) 00000100:00100000:3.0:1790096855.803842:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11534:x1877052305260928:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1671us (1922us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790096855.803850:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1790096855.808818:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.809301:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305261056 00000100:00100000:2.0:1790096855.809311:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305261056 00000100:00100000:2.0:1790096855.809372:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1790096855.809382:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11534:x1877052305261056:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790096855.809902:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.809921:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.809934:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.809966:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.809973:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.809979:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.810069:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.810074:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.810082:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.810094:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096855.810097:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096855.810102:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.810108:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.810221:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11534:x1877052305261056:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 839us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096855.810230:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1790096855.813897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.813980:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305261312 00000100:00100000:3.0:1790096855.813991:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305261312 00000100:00100000:3.0:1790096855.814059:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1790096855.814070:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11534:x1877052305261312:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096855.814475:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11534:x1877052305261312:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 405us (587us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790096855.814483:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1790096855.858332:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.858671:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305261568 00000100:00100000:1.0:1790096855.858689:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305261568 00000100:00100000:1.0:1790096855.858753:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:1.0:1790096855.858763:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11068:x1877052305261568:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790096855.858788:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096855.858810:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab658c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211c4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.858929:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.858945:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.858979:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.859013:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096855.859026:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 28 pid: 5851 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.859040:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee584e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324129024:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096855.859140:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096855.865057:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096855.865114:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee584e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1877052324129024:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096855.865144:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.865222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305261696 00000100:00100000:3.0:1790096855.865230:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305261696 00010000:00010000:3.0:1790096855.865270:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 29 pid: 5851 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.865312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1790096855.865322:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+29:2363:x1877052305261696:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096855.865337:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096855.865344:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 29 pid: 5851 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865356:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 29 pid: 5851 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865378:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211bd expref: 29 pid: 5851 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865404:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:3.0:1790096855.865409:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865433:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865439:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.865709:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096855.865766:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+28:2363:x1877052305261696:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 443us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.865775:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00010000:00010000:2.0:1790096855.867100:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.867113:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096855.867133:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790096855.867313:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab658c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.867333:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.867356:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096855.867359:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790096855.867362:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e800, rc 0) 00000100:00100000:2.0:1790096855.867433:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11068:x1877052305261568:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8671us (9112us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790096855.867442:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:0.0:1790096855.870568:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.870742:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305261952 00000100:00100000:3.0:1790096855.870753:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305261952 00000100:00100000:3.0:1790096855.870802:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1790096855.870813:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11068:x1877052305261952:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1790096855.871091:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.871108:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.871119:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096855.871171:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1790096855.871198:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c384d4b reply state 000000003de4763b transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096855.871206:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790096855.871258:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1790096855.871494:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11068:x1877052305261952:12345-192.168.203.11@tcp:36:bash.0 Request processed in 681us (932us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1790096855.871769:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000020:00080000:3.0:1790096855.871777:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790096855.876994:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877012:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877018:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877024:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.877028:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877035:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877050:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096855.877053:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.877058:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.877064:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab65a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096855.879978:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.880024:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262080 00000100:00100000:2.0:1790096855.880033:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262080 00000100:00100000:2.0:1790096855.880086:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:2.0:1790096855.880097:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11068:x1877052305262080:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096855.880119:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096855.880140:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab65a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211cb expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.880202:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab65a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211cb expref: 32 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.880218:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab65a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211cb expref: 32 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.880238:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096855.880241:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096855.880246:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096855.880358:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11068:x1877052305262080:12345-192.168.203.11@tcp:101:bash.0 Request processed in 262us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096855.880365:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1790096855.886768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.887032:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262208 00000100:00100000:3.0:1790096855.887043:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262208 00000100:00100000:3.0:1790096855.887108:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790096855.887118:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:11068:x1877052305262208:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096855.887136:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096855.887159:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211d2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790096855.887187:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2b5d6, atime: 0x6ab2b5d4, ctime: 0x6ab2b5d6, blocks: 0xb 00010000:00010000:3.0:1790096855.887213:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1790096855.887217:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096855.887225:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.887241:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096855.887253:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6200, rc 0) 00000100:00100000:3.0:1790096855.887314:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:11068:x1877052305262208:12345-192.168.203.11@tcp:101:bash.0 Request processed in 197us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096855.887321:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790096855.890215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096855.890448:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262336 00000100:00100000:3.0:1790096855.890457:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262336 00002000:00010000:3.0:1790096855.890528:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1790096855.890548:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee587800 with x1877052305262336 ext(0->18446744073709551615) 00002000:00010000:3.0:1790096855.890558:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee587800. 00000100:00100000:3.0:1790096855.890594:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790096855.890603:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305262336:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:3.0:1790096855.891257:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790096855.891261:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790096854 -> 1790096855 00002000:00010000:3.0:1790096855.891264:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790096852 -> 1790096852 00002000:00010000:3.0:1790096855.891266:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790096854 -> 1790096855 00002000:00010000:3.0:1790096855.891268:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790096855.891349:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2360:x1877052305262336:12345-192.168.203.11@tcp:10:bash.0 Request processed in 745us (1141us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790096855.891358:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00002000:00010000:3.0:1790096855.891364:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1790096855.891367:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee587800 with x1877052305262336 ext(0->18446744073709551615) 00002000:00010000:3.0:1790096855.891372:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee587800. 00000100:00100000:2.0:1790096855.934530:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096855.934624:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096855.934788:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324129152 00000100:00100000:1.0:1790096855.934797:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324129152 00000100:00100000:1.0:1790096855.934847:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790096855.934858:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096855.934883:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1790096855.937699:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2773us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096855.937714:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790096855.937837:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096855.994227:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096855.994381:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262464 00000100:00100000:2.0:1790096855.994390:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262464 00000100:00100000:2.0:1790096855.994461:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:2.0:1790096855.994471:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11548:x1877052305262464:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1790096855.994561:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994576:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994587:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994602:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994620:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994627:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994893:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994902:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994909:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790096855.994945:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994956:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994969:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994976:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.994982:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.994986:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995004:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995017:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096855.995020:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.995024:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995030:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab65b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995041:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995047:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995052:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995057:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.995066:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995072:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995080:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7ab00) 00010000:00010000:2.0:1790096855.995082:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.995085:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995091:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab65bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995105:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995111:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995117:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995122:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096855.995125:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995131:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995137:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096855.995139:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096855.995148:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096855.995154:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096855.995232:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11548:x1877052305262464:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 761us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096855.995241:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:1.0:1790096856.060711:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.060820:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262720 00000100:00100000:0.0:1790096856.060830:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262720 00000100:00100000:0.0:1790096856.060922:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790096856.060934:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+32:11551:x1877052305262720:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096856.060956:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096856.060978:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab65cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211d9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061138:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061153:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061183:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061199:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061206:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061213:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061462:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab65e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061471:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab65e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061478:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab65e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096856.061487:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790096856.061730:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061738:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061744:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061750:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.061760:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061768:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061780:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096856.061783:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096856.061787:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061793:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab65d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061804:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061811:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061816:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061822:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.061825:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061830:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061837:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaad43d3800) 00010000:00010000:0.0:1790096856.061840:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096856.061848:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061854:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab65d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061896:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab65cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d9 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061911:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab65e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d9 expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.061918:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:0.0:1790096856.061921:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790096856.061923:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096856.061993:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11551:x1877052305262720:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1061us (1292us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790096856.062001:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00080000:3.0:1790096856.062360:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096856.067139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.067281:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305262848 00000100:00100000:2.0:1790096856.067292:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305262848 00000100:00100000:2.0:1790096856.067359:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:2.0:1790096856.067370:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11551:x1877052305262848:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790096856.067459:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.067475:0:7513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.067484:0:7513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.067517:0:7513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.067809:0:7513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 34 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.067825:0:7513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324129280:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096856.067946:0:7513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096856.071935:0:7513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7513:1877052324129280:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096856.071967:0:7513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.073356:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.073553:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305263104 00000100:00100000:1.0:1790096856.073562:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305263104 00000100:00100000:1.0:1790096856.073620:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1790096856.073630:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+35:5599:x1877052305263104:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790096856.074150:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+36:5599:x1877052305263104:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 520us (800us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790096856.074158:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1790096856.080022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.080138:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305263232 00000100:00100000:3.0:1790096856.080148:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305263232 00010000:00010000:3.0:1790096856.080194:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 36 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.080238:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:3.0:1790096856.080248:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+36:2363:x1877052305263232:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096856.080264:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096856.080271:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 36 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080299:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 36 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080323:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6593 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211c4 expref: 36 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080340:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:3.0:1790096856.080345:0:11191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080355:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080364:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.080739:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096856.080797:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+35:2363:x1877052305263232:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 550us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096856.080806:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00010000:00010000:2.0:1790096856.080873:0:7513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080882:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080912:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080919:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080926:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080932:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.080936:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080943:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080953:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:2.0:1790096856.080955:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096856.080959:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.080977:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab65ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.081019:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11551:x1877052305262848:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 13651us (13888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.081027:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:0.0:1790096856.092049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.092265:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305263488 00000100:00100000:1.0:1790096856.092275:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305263488 00000100:00100000:1.0:1790096856.092329:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790096856.092339:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+34:11551:x1877052305263488:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790096856.092812:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11551:x1877052305263488:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 473us (771us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790096856.092821:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790096856.250712:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.251082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305263744 00000100:00100000:3.0:1790096856.251093:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305263744 00000100:00100000:3.0:1790096856.251415:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1790096856.251425:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+35:11562:x1877052305263744:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790096856.251461:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096856.251483:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab65f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251582:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251596:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251607:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251621:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251629:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251670:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251910:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab660a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.251927:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096856.251937:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790096856.252025:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.252034:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.252070:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.252076:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096856.252080:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.252088:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.252100:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096856.254871:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096856.254883:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254893:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab65fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254915:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254922:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254929:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254935:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096856.254939:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254969:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254984:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096856.254987:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096856.254990:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.254995:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.255086:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab65f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e0 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.255100:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab660a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e0 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.256293:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:3.0:1790096856.256296:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096856.256300:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6c00, rc 0) 00000100:00100000:3.0:1790096856.256445:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+37:11562:x1877052305263744:12345-192.168.203.11@tcp:101:cat.0 Request processed in 5018us (5739us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790096856.256463:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1790096856.269193:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.269508:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264000 00000100:00100000:1.0:1790096856.269528:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264000 00000100:00100000:1.0:1790096856.269586:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790096856.269596:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+37:11562:x1877052305264000:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:1.0:1790096856.270454:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11562:x1877052305264000:12345-192.168.203.11@tcp:35:cat.0 Request processed in 855us (1267us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1790096856.270464:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1790096856.326017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.326122:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264256 00000100:00100000:3.0:1790096856.326132:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264256 00000100:00100000:3.0:1790096856.326190:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:3.0:1790096856.326200:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11563:x1877052305264256:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1790096856.326270:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790096856.326296:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6c00/0xcc97d9eae5ab660a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e0 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326320:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab65e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d9 expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326334:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab65a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211cb expref: 36 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326345:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac4e7a400) 00010000:00010000:3.0:1790096856.326357:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096856.326377:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326391:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326401:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326416:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326422:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326428:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326766:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326776:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.326783:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790096856.327345:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1790096856.327357:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385897720897ns, next at 386897718517ns, rc = 0 00010000:00010000:3.0:1790096856.327415:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327425:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327433:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327441:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327447:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327454:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327471:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096856.327490:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327502:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327509:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327515:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096856.327519:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327527:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327537:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:3.0:1790096856.327540:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790096856.327545:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327550:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6626 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327566:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327572:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327578:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327583:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096856.327592:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327597:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327605:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096856.327607:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096856.327610:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.327615:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6618 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096856.327625:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091502d8b reply state 000000001f834923 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.327679:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096856.327767:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+37:11563:x1877052305264256:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1566us (1757us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790096856.327777:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00010000:00010000:0.0:1790096856.328193:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096856.328200:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.328208:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096856.328211:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.328220:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.328241:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eaac2c3c100) 00010000:00010000:0.0:1790096856.328244:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790096856.328248:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.328254:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab662d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.328270:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096856.328273:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096856.328275:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096856.333521:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333539:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333547:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333553:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.333557:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333565:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333581:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096856.333584:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096856.333589:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.333616:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab661f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.404999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.405100:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264512 00000100:00100000:2.0:1790096856.405111:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264512 00000100:00100000:2.0:1790096856.405186:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:2.0:1790096856.405205:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+36:11569:x1877052305264512:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096856.405232:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096856.405255:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6634 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211e7 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405377:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405393:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405405:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405421:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405429:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.405453:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790096856.406317:0:7513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1790096856.406481:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406492:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406502:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406694:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406704:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406711:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406717:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.406722:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406730:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406744:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096856.406747:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096856.406760:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406767:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab663b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790096856.406781:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088f233ee reply state 00000000f138c880 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.406789:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790096856.406825:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab6634 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 39 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406841:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 38 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.406848:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:2.0:1790096856.406850:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096856.406853:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9400, rc 0) 00000100:00100000:2.0:1790096856.407042:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+39:11569:x1877052305264512:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1835us (2040us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790096856.407051:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00010000:00010000:2.0:1790096856.413461:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413479:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413487:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413511:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.413516:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413534:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413552:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7ab00) 00010000:00010000:2.0:1790096856.413556:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096856.413561:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.413567:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab6642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.417178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.419113:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264640 00000100:00100000:2.0:1790096856.419127:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264640 00000100:00100000:2.0:1790096856.419329:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1790096856.419341:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305264640:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096856.419357:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096856.419378:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211ee expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096856.419405:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096856.419425:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1790096856.419430:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096856.419438:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.419485:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.419498:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9c00, rc 0) 00000100:00100000:2.0:1790096856.419914:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305264640:12345-192.168.203.11@tcp:101:bash.0 Request processed in 575us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.419922:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00080000:3.0:1790096856.420899:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096856.425868:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.425958:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264768 00000100:00100000:0.0:1790096856.425968:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264768 00000100:00100000:0.0:1790096856.426021:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1790096856.426031:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+8:11569:x1877052305264768:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790096856.426048:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096856.426065:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211f5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.426096:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.426104:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096856.426109:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096856.426114:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.426144:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.426156:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.426189:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324129408:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096856.426284:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096856.432334:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1877052324129408:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096856.432373:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.432395:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691600, rc 0) 00000100:00100000:0.0:1790096856.432441:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.432550:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+9:11569:x1877052305264768:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6519us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096856.432576:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790096856.435162:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305264896 00000100:00100000:2.0:1790096856.435181:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305264896 00010000:00010000:3.0:1790096856.435335:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.435370:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1790096856.435378:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2362:x1877052305264896:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096856.435392:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096856.435412:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.435426:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.435449:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abed867e/0xcc97d9eae5ab6657 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211ee expref: 9 pid: 6695 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.435465:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790096856.435469:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096856.435477:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.435486:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.435523:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.435548:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1877052324129536:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790096856.435622:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac59043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096856.455408:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1877052324129536:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790096856.455437:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096856.455529:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305264896:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 20148us (23086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096856.455540:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1790096856.460772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.461896:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305265152 00000100:00100000:1.0:1790096856.461907:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305265152 00000100:00100000:1.0:1790096856.461977:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790096856.461987:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+38:11569:x1877052305265152:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1790096856.462406:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+39:11569:x1877052305265152:12345-192.168.203.11@tcp:35:bash.0 Request processed in 419us (1642us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1790096856.462415:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:0.0:1790096856.637093:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096856.646410:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.646502:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305265280 00000100:00100000:3.0:1790096856.646520:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305265280 00000100:00100000:3.0:1790096856.646580:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:3.0:1790096856.646591:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+39:11585:x1877052305265280:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096856.646614:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096856.646672:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38211fc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.646738:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.646915:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.646928:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096856.646968:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790096856.646972:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096856.647007:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.647032:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211fc expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.647052:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211fc expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.647060:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096856.647063:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096856.647067:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096856.647133:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+40:11585:x1877052305265280:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 544us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096856.647140:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:0.0:1790096856.654495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.654625:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305265536 00000100:00100000:1.0:1790096856.654679:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305265536 00000100:00100000:1.0:1790096856.654738:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:1.0:1790096856.654764:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+40:11585:x1877052305265536:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096856.654786:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096856.654807:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821203 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.654907:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab667a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.654920:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab667a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.654932:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab667a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096856.654943:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790096856.655072:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821203 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.655090:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab667a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821203 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.655113:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:1.0:1790096856.655117:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790096856.655120:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fe00, rc 0) 00000100:00100000:1.0:1790096856.655387:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+42:11585:x1877052305265536:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 638us (900us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790096856.655395:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1790096856.675250:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.675298:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.675443:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305265920 00000100:00100000:1.0:1790096856.675452:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305265920 00000100:00100000:1.0:1790096856.675531:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1790096856.675542:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+42:2361:x1877052305265920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096856.675558:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096856.675581:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab667a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821203 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.675600:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:1.0:1790096856.675604:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096856.675712:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+41:2361:x1877052305265920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 171us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096856.675720:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096856.675952:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305265792 00000100:00100000:2.0:1790096856.675957:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305265792 00000100:00100000:2.0:1790096856.675999:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:2.0:1790096856.676007:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+41:11585:x1877052305265792:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096856.676027:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096856.676046:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382120a expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.676140:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.676153:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.676163:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096856.676205:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790096856.676320:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab6688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382120a expref: 44 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.676335:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382120a expref: 43 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.676342:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:2.0:1790096856.676345:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790096856.676347:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8400, rc 0) 00000100:00100000:2.0:1790096856.676376:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+43:11585:x1877052305265792:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 370us (1134us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790096856.676383:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:2.0:1790096856.682900:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.686950:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266048 00000100:00100000:1.0:1790096856.686973:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266048 00000100:00100000:1.0:1790096856.687078:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790096856.687091:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305266048:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1790096856.687150:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.687194:0:7012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.687204:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096856.687209:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096856.687214:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.687272:0:7012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.687288:0:7012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 8 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096856.687304:0:7012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee584380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7012:1877052324129664:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096856.687438:0:7012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096856.692279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.692528:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266176 00000100:00100000:2.0:1790096856.692541:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266176 00002000:00100000:2.0:1790096856.692611:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eaafbaab800 x1877052305266176/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:172/0 lens 504/0 e 0 to 0 dl 1790096867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096856.692624:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafbaab800 with x1877052305266176 ext(0->8) 00010000:00010000:2.0:1790096856.692701:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 9 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.692720:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 9 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096856.692729:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafbaab800 00000100:00100000:2.0:1790096856.692787:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790096856.692797:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305266176:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:2.0:1790096856.693386:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2363:x1877052305266176:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 588us (1120us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790096856.693396:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:2.0:1790096856.693404:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eaafbaab800 x1877052305266176/t4294967308(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:172/0 lens 504/448 e 0 to 0 dl 1790096867 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096856.693413:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaafbaab800 with x1877052305266176 ext(0->8) 00010000:00010000:2.0:1790096856.693420:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.693439:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096856.693448:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eaafbaab800 00000100:00100000:1.0:1790096856.694398:0:7012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee584380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7012:1877052324129664:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096856.694433:0:7012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.699724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096856.699840:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266304 00000100:00100000:3.0:1790096856.699858:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266304 00010000:00010000:3.0:1790096856.699916:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.699958:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:3.0:1790096856.699968:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2361:x1877052305266304:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096856.699985:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790096856.700005:0:11191:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790096856.700008:0:11191:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790096856 00002000:00010000:3.0:1790096856.700011:0:11191:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790096856 00002000:00010000:3.0:1790096856.700014:0:11191:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790096856 00010000:00010000:3.0:1790096856.700020:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.700053:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.700078:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053fcb8aa/0xcc97d9eae5ab665e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211f5 expref: 11 pid: 6696 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.700095:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096856.700100:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096856.700105:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.700116:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096856.700158:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096856.700236:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2361:x1877052305266304:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 268us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096856.700244:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00010000:00010000:2.0:1790096856.700913:0:7012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.700943:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.700985:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.700995:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.701151:0:7012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.701161:0:7012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096856.701166:0:7012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.701177:0:7012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.701199:0:7012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.701207:0:7012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab669d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.701332:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305266048:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 14241us (18437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.701344:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790096856.706787:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.711339:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266560 00000100:00100000:1.0:1790096856.711356:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266560 00000100:00100000:1.0:1790096856.711441:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790096856.711453:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+43:11585:x1877052305266560:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1790096856.711543:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382120a expref: 43 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096856.712019:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1790096856.712101:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1790096856.712586:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1790096856.712784:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.712835:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 47 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.712846:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.712953:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 47 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.712995:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 47 pid: 7513 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.713045:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaa8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324129792:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096856.713232:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d540 going to sleep for 11 seconds 00000100:00100000:1.0:1790096856.726268:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaa8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1877052324129792:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096856.726311:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096856.731139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.731222:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266688 00000100:00100000:0.0:1790096856.731236:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266688 00010000:00010000:0.0:1790096856.731292:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 48 pid: 7513 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.731339:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1790096856.731351:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+48:2362:x1877052305266688:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096856.731370:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096856.731378:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 48 pid: 7513 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.731394:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 48 pid: 7513 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.731422:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab6649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211e7 expref: 48 pid: 7513 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.732413:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:0.0:1790096856.732426:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.732838:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.732877:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.732937:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096856.733047:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+47:2362:x1877052305266688:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1693us (1922us total) trans 0 rc 0/0 00010000:00010000:2.0:1790096856.733316:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.733326:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096856.733514:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1790096856.733812:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790096856.733966:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324129920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096856.734043:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096856.734295:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324129920 00000100:00100000:2.0:1790096856.734304:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324129920 00000100:00100000:2.0:1790096856.734374:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096856.734384:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1877052324129920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096856.734482:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1877052324129920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.734490:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790096856.734520:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096856.734533:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096856.734569:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324129920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790096856.735267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000001:00080000:2.0:1790096856.739047:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1790096856.739778:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324130048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790096856.739872:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096856.739914:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096856.742797:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324130048 00000100:00100000:3.0:1790096856.742878:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324130048 00000100:00100000:3.0:1790096856.743018:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790096856.743033:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1877052324130048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790096856.743410:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5855:x1877052324130048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 379us (3535us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790096856.743436:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096856.743914:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1877052324130048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790096856.744071:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1790096856.744136:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744148:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744157:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744164:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.744170:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744179:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744200:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:0.0:1790096856.744204:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790096856.744210:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.744225:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790096856.744485:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790096856.744608:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1790096856.744623:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386314986646ns, next at 387314983790ns, rc = 0 00000001:00080000:0.0:1790096856.744630:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1790096856.744730:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4e7af00) 00010000:00010000:0.0:1790096856.744734:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790096856.744754:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8400/0xcc97d9eae5ab668f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382120a expref: 51 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096856.744903:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+50:11585:x1877052305266560:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 33451us (38127us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1790096856.744914:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000020:00080000:0.0:1790096856.744919:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790096856.752967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096856.753614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305266816 00000100:00100000:1.0:1790096856.753630:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305266816 00000100:00100000:1.0:1790096856.753742:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1790096856.753754:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+50:11585:x1877052305266816:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096856.753786:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096856.753819:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab66ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821211 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.753902:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab66ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821211 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.753920:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab66ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821211 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096856.753944:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096856.753948:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790096856.753952:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f200, rc 0) 00000100:00100000:1.0:1790096856.754032:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+51:11585:x1877052305266816:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 280us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096856.754040:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:0.0:1790096856.762116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.762224:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305267072 00000100:00100000:2.0:1790096856.762238:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305267072 00000100:00100000:2.0:1790096856.762305:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790096856.762316:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+51:11585:x1877052305267072:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790096856.763305:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+52:11585:x1877052305267072:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 982us (1195us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1790096856.763317:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790096856.870735:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.870857:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305267200 00000100:00100000:2.0:1790096856.870871:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305267200 00000100:00100000:2.0:1790096856.870946:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:2.0:1790096856.870978:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+52:11595:x1877052305267200:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1790096856.871156:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871180:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871194:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871213:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871220:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871226:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871345:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871354:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871362:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790096856.871416:0:8484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871432:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871446:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871453:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871460:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.871465:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871473:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871488:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096856.871492:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096856.871498:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871505:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9e00/0xcc97d9eae5ab66b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871521:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871527:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871532:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871537:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.871546:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871552:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871561:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac4e7a600) 00010000:00010000:2.0:1790096856.871564:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096856.871567:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871573:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871592:0:8484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871599:0:8484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871605:0:8484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871610:0:8484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.871613:0:8484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871619:0:8484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871626:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096856.871628:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096856.871842:0:8484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.871848:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.871943:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+52:11595:x1877052305267200:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 966us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.871953:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:3.0:1790096856.908882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.909056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305267456 00000100:00100000:0.0:1790096856.909072:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305267456 00000100:00100000:0.0:1790096856.909166:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1790096856.909180:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+52:11598:x1877052305267456:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096856.909214:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096856.909243:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab66c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821218 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909338:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909379:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909396:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909415:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909423:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909430:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909610:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909620:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.909628:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096856.912776:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790096856.912965:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.912977:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.912985:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913014:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.913020:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913031:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913055:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096856.913058:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096856.913064:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913071:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab66ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913835:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913848:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913854:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913859:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096856.913863:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913870:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913906:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaad43d3800) 00010000:00010000:0.0:1790096856.913909:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096856.913913:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.913919:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab66d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.914010:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab66c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821218 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.914029:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821218 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096856.914036:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096856.914038:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096856.914041:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691e00, rc 0) 00000100:00100000:0.0:1790096856.915855:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+54:11598:x1877052305267456:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 6664us (6974us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790096856.915869:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1790096856.921805:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096856.922319:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305267584 00000100:00100000:2.0:1790096856.922334:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305267584 00000100:00100000:2.0:1790096856.922420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:2.0:1790096856.922432:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+54:11598:x1877052305267584:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790096856.922879:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922902:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922917:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922948:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922954:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922961:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.922968:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096856.922993:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.923002:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.923017:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096856.923020:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096856.923027:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096856.923034:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096856.924468:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+54:11598:x1877052305267584:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 2011us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096856.924484:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:3.0:1790096856.927557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096856.927696:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305267840 00000100:00100000:0.0:1790096856.927710:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305267840 00000100:00100000:0.0:1790096856.927777:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1790096856.927788:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+54:11598:x1877052305267840:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096856.928121:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+55:11598:x1877052305267840:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 332us (576us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790096856.928154:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790096857.064693:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.064813:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268096 00000100:00100000:2.0:1790096857.064828:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268096 00000100:00100000:2.0:1790096857.064905:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:2.0:1790096857.064918:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+55:11608:x1877052305268096:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096857.064955:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.064960:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790096857.064999:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab666c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211fc expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065023:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096857.065030:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096857.065047:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382121f expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065345:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065363:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065376:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096857.065390:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790096857.065568:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab66f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382121f expref: 57 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065585:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382121f expref: 56 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.065592:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.065595:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096857.065598:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9c00, rc 0) 00000100:00100000:2.0:1790096857.065745:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+56:11608:x1877052305268096:12345-192.168.203.11@tcp:101:bash.0 Request processed in 827us (1063us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790096857.065755:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1790096857.078762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.078923:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268352 00000100:00100000:0.0:1790096857.078935:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268352 00000100:00100000:0.0:1790096857.079009:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:0.0:1790096857.079020:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+56:11608:x1877052305268352:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1790096857.079079:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790096857.079106:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9c00/0xcc97d9eae5ab66f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382121f expref: 56 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.079131:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab66dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821218 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.079141:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.079146:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096857.079363:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.079378:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.079389:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096857.079440:0:5853:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1790096857.079466:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e649911 reply state 00000000e95763d9 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.079476:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096857.079934:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+57:11608:x1877052305268352:12345-192.168.203.11@tcp:36:bash.0 Request processed in 914us (1181us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790096857.079942:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000020:00080000:0.0:1790096857.079948:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1790096857.084332:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1790096857.084354:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1790096857.084365:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1790096857.085062:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085075:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085083:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085089:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.085094:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085102:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085119:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.085122:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096857.085127:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.085133:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6706 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.086134:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.086210:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268480 00000100:00100000:2.0:1790096857.086220:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268480 00000100:00100000:2.0:1790096857.086281:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:2.0:1790096857.086307:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+56:11608:x1877052305268480:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790096857.086332:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.086352:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab670d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821226 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086438:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086463:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086475:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096857.086505:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790096857.086509:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096857.086529:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086555:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab670d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086571:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.086579:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.086581:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096857.086585:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096857.086804:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+57:11608:x1877052305268480:12345-192.168.203.11@tcp:101:bash.0 Request processed in 499us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.086821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:2.0:1790096857.101599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.102047:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268736 00000100:00100000:0.0:1790096857.102058:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268736 00000100:00100000:0.0:1790096857.102119:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1790096857.102128:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+57:11608:x1877052305268736:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790096857.102384:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+58:11608:x1877052305268736:12345-192.168.203.11@tcp:35:bash.0 Request processed in 256us (794us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1790096857.102392:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790096857.198935:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.199076:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268864 00000100:00100000:2.0:1790096857.199087:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268864 00000100:00100000:2.0:1790096857.199151:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:2.0:1790096857.199161:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+58:11614:x1877052305268864:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096857.199186:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.199208:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab671b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382122d expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199273:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199288:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199300:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096857.199334:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790096857.199338:0:7513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096857.199354:0:7513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199378:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9600/0xcc97d9eae5ab671b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382122d expref: 60 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199398:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382122d expref: 59 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.199425:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096857.199427:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096857.199431:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8e00, rc 0) 00000100:00100000:2.0:1790096857.199515:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305268864:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 355us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.199522:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:0.0:1790096857.207679:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.207826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305268992 00000100:00100000:3.0:1790096857.207837:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305268992 00000100:00100000:3.0:1790096857.207908:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:3.0:1790096857.207919:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305268992:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096857.207936:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096857.207955:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821234 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208015:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208029:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208040:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208055:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208062:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208086:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208175:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208184:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208192:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096857.208227:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790096857.208231:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096857.208249:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208261:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208269:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208275:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208282:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208288:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096857.208292:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208306:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208318:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096857.208322:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096857.208327:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208334:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208348:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208354:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208359:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208365:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096857.208368:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208374:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208381:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaac2c3c000) 00010000:00010000:3.0:1790096857.208384:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096857.208387:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208404:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6000/0xcc97d9eae5ab6737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208438:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821234 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208452:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821234 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.208460:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096857.208463:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096857.208465:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6a00, rc 0) 00000100:00100000:3.0:1790096857.208534:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11614:x1877052305268992:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 616us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096857.208541:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:3.0:1790096857.218117:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.218204:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.218713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305269120 00000100:00100000:1.0:1790096857.218723:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305269120 00000100:00100000:1.0:1790096857.218789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790096857.218798:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+60:2361:x1877052305269120:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096857.218814:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096857.218842:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab673e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821234 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.218869:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096857.218873:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096857.218938:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+59:2361:x1877052305269120:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 141us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.218946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790096857.219415:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305269376 00000100:00100000:0.0:1790096857.219421:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305269376 00000100:00100000:0.0:1790096857.219469:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:0.0:1790096857.219477:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305269376:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096857.219492:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096857.219764:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382123b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.219866:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.219881:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.219890:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.219922:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.219936:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 60 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.219950:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324130176:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096857.220080:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59df00 going to sleep for 11 seconds 00000100:00100000:3.0:1790096857.227915:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.228140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305269504 00000100:00100000:1.0:1790096857.228150:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305269504 00010000:00010000:1.0:1790096857.228190:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 61 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.228237:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790096857.228248:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+61:2362:x1877052305269504:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096857.228263:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096857.228270:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 61 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.228283:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 61 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.228326:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096857.228331:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.228340:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.228347:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.228367:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096857.228431:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+61:2362:x1877052305269504:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 184us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.228440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00010000:00010000:0.0:1790096857.230126:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821226 expref: 60 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.230148:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324130176:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096857.230170:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.230180:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.230185:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096857.230208:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790096857.230382:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.230397:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.230405:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.230408:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790096857.230411:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690200, rc 0) 00000100:00100000:0.0:1790096857.230489:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11614:x1877052305269376:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 11012us (12283us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1790096857.230497:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1790096857.234545:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.235016:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305269760 00000100:00100000:0.0:1790096857.235038:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305269760 00000100:00100000:0.0:1790096857.235100:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790096857.235111:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11614:x1877052305269760:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1790096857.235128:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096857.235156:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab66ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821211 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.235174:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.235179:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096857.235242:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305269760:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 132us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.235250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1790096857.240544:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.240844:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305269888 00000100:00100000:1.0:1790096857.240855:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305269888 00000100:00100000:1.0:1790096857.240911:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:1.0:1790096857.240921:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305269888:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:1.0:1790096857.241028:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.241044:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.241056:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096857.241230:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1790096857.241314:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305269888:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 394us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.241327:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:3.0:1790096857.245719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.245856:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270016 00000100:00100000:2.0:1790096857.245865:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270016 00000100:00100000:2.0:1790096857.245921:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:2.0:1790096857.245932:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+59:11614:x1877052305270016:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096857.245951:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.245978:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821242 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246035:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246045:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246064:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246075:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246088:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.246105:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096857.246110:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.246117:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8000, rc 0) 00000100:00100000:2.0:1790096857.246227:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11614:x1877052305270016:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 296us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.246234:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000040:00080000:1.0:1790096857.340898:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096857.340908:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096857.344921:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1790096857.344937:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790096857.345113:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee585500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324130304:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790096857.345233:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096857.363191:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee585500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324130304:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790096857.363221:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.364818:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270144 00000100:00100000:0.0:1790096857.364831:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270144 00000100:00100000:0.0:1790096857.364913:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:0.0:1790096857.364922:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11615:x1877052305270144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790096857.364960:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790096857.365108:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11615:x1877052305270144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 186us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.365116:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:2.0:1790096857.372320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.372429:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270272 00000100:00100000:3.0:1790096857.372439:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270272 00000100:00100000:3.0:1790096857.372523:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1790096857.372534:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11615:x1877052305270272:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790096857.372619:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372685:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372697:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372714:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372721:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372728:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372751:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372760:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372782:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096857.372820:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790096857.372825:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096857.372837:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372848:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372862:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372868:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372874:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096857.372878:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372886:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372897:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096857.372901:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096857.372906:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372912:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6768 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372926:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372931:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372936:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372941:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096857.372949:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372955:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372963:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9eaac2c3c000) 00010000:00010000:3.0:1790096857.372965:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096857.372968:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372973:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab676f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372988:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.372994:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.373000:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.373005:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096857.373007:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.373013:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.373020:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096857.373023:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096857.373033:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.373039:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096857.373127:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11615:x1877052305270272:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 594us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096857.373136:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1790096857.377083:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.377703:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270528 00000100:00100000:2.0:1790096857.377714:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270528 00000100:00100000:2.0:1790096857.377783:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:2.0:1790096857.377794:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+60:11615:x1877052305270528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.377815:0:7513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.377835:0:7513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab677d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821249 expref: -99 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.377932:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.377948:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.377959:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096857.377971:0:7513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790096857.378083:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378108:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378115:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378121:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096857.378125:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378132:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378145:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.378148:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790096857.378152:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378158:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378199:0:7513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab677d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821249 expref: 62 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378209:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096857.378211:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096857.378215:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab677d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821249 expref: 62 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.378224:0:7513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096857.378292:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305270528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 500us (1219us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1790096857.378299:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:0.0:1790096857.384595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.384788:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270656 00000100:00100000:1.0:1790096857.384798:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270656 00000100:00100000:1.0:1790096857.384860:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:1.0:1790096857.384870:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305270656:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790096857.384904:0:8484:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790096857.385009:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305270656:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 140us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.385017:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:3.0:1790096857.399528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.399757:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305270912 00000100:00100000:2.0:1790096857.399777:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305270912 00000100:00100000:2.0:1790096857.399843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:2.0:1790096857.399854:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305270912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.399874:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.399877:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790096857.399902:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382122d expref: 61 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.399922:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:2.0:1790096857.399927:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096857.399940:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6792 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821250 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790096857.400327:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790096857.401369:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.401389:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.401401:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.401479:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab6792 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821250 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.401600:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821250 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.401609:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac4e7a900) 00010000:00010000:2.0:1790096857.401612:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096857.401615:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9a00, rc 0) 00000100:00100000:2.0:1790096857.401714:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+62:11615:x1877052305270912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1861us (2206us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1790096857.401724:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:0.0:1790096857.412020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.412110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305271168 00000100:00100000:1.0:1790096857.412122:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305271168 00000100:00100000:1.0:1790096857.412169:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:1.0:1790096857.412180:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+62:11615:x1877052305271168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790096857.412234:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096857.412258:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9a00/0xcc97d9eae5ab6799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821250 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412275:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac4e7a900) 00010000:00010000:1.0:1790096857.412298:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790096857.412317:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412330:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412340:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412353:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412360:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412365:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412432:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412453:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412461:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412466:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096857.412471:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412478:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412493:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:1.0:1790096857.412495:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096857.412499:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412627:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab67a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412720:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412727:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412733:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412738:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096857.412741:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412747:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412755:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc4881d6f (ffff9eaac4db7e00) 00010000:00010000:1.0:1790096857.412757:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096857.412760:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.412765:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab67ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4881d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.412894:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305271168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 714us (883us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790096857.412901:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:0.0:1790096857.425125:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.434292:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305271296 00000100:00100000:3.0:1790096857.434307:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305271296 00000100:00100000:3.0:1790096857.434429:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:3.0:1790096857.434440:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+61:11615:x1877052305271296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096857.434461:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096857.434485:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821257 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434532:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434545:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434558:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434675:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434709:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.434717:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:3.0:1790096857.434720:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790096857.434724:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7c00, rc 0) 00000100:00100000:2.0:1790096857.434849:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+62:11615:x1877052305271296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 409us (9730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.434857:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:2.0:1790096857.443148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.443273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305271552 00000100:00100000:1.0:1790096857.443283:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305271552 00000100:00100000:1.0:1790096857.443346:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:1.0:1790096857.443355:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+62:11615:x1877052305271552:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790096857.443434:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.443452:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.443464:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096857.443759:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1790096857.444067:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387014431287ns, next at 388014427771ns, rc = 0 00000004:00010000:2.0:1790096857.444158:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2e34863 reply state 0000000071e2f4b5 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.444168:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790096857.444278:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+64:11615:x1877052305271552:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 922us (1137us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790096857.444286:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00010000:00010000:2.0:1790096857.446706:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446723:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446764:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446771:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096857.446776:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446784:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446801:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:2.0:1790096857.446804:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790096857.446809:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.446815:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab67c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.447377:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.447580:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305271680 00000100:00100000:3.0:1790096857.447590:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305271680 00000100:00100000:3.0:1790096857.447666:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:3.0:1790096857.447677:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+63:11615:x1877052305271680:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096857.447701:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096857.447720:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382125e expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.452370:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 64 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.452396:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 64 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.452424:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:2.0:1790096857.452427:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096857.452431:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7600, rc 0) 00000100:00100000:2.0:1790096857.452520:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+64:11615:x1877052305271680:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4843us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.452543:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:3.0:1790096857.457303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.458412:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305271808 00000100:00100000:2.0:1790096857.458426:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305271808 00000100:00100000:2.0:1790096857.458501:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1790096857.458514:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2363:x1877052305271808:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790096857.458599:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096857.458842:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2363:x1877052305271808:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 331us (1548us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1790096857.458849:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1790096857.462243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.462411:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272064 00000100:00100000:2.0:1790096857.462422:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272064 00000100:00100000:2.0:1790096857.462486:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790096857.462496:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+64:11615:x1877052305272064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790096857.462795:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+65:11615:x1877052305272064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 299us (562us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790096857.462803:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1790096857.469053:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.471950:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272320 00000100:00100000:2.0:1790096857.471967:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272320 00000100:00100000:2.0:1790096857.472048:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:2.0:1790096857.472060:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+65:11615:x1877052305272320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790096857.472193:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+65:11615:x1877052305272320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 134us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.472200:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:3.0:1790096857.474963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.475067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272448 00000100:00100000:2.0:1790096857.475077:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272448 00000100:00100000:2.0:1790096857.475153:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:2.0:1790096857.475164:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+65:11615:x1877052305272448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.475184:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.475204:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab67d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821265 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475273:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475287:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475297:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096857.475330:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096857.475347:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475371:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab67d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821265 expref: 67 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475387:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821265 expref: 66 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.475395:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:2.0:1790096857.475398:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790096857.475401:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8e00, rc 0) 00000100:00100000:2.0:1790096857.475462:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+66:11615:x1877052305272448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 299us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.475478:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:3.0:1790096857.483370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.483450:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272576 00000100:00100000:2.0:1790096857.483462:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272576 00000100:00100000:2.0:1790096857.483529:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790096857.483540:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+10:2360:x1877052305272576:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.483559:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.483583:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382126c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096857.483613:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2b5d9, blocks: 0x1 00010000:00010000:2.0:1790096857.483689:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1790096857.483694:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.483704:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.483723:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.483738:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096857.483795:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2360:x1877052305272576:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 256us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.483802:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1790096857.491858:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.492038:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272832 00000100:00100000:2.0:1790096857.492050:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272832 00000100:00100000:2.0:1790096857.492113:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:2.0:1790096857.492124:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+66:11615:x1877052305272832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790096857.492254:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+66:11615:x1877052305272832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 131us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.492262:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:0.0:1790096857.496344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.496674:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305272960 00000100:00100000:2.0:1790096857.496683:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305272960 00000100:00100000:2.0:1790096857.496758:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1790096857.496769:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+11:11615:x1877052305272960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.496787:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096857.496805:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821273 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.496837:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.496846:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.496850:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.496856:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.496890:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.496904:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.496918:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877052324130432:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096857.497343:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790096857.517341:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877052324130432:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096857.517377:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.517398:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096857.517483:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+12:11615:x1877052305272960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 20716us (21146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.517500:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1790096857.520926:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.521155:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273088 00000100:00100000:2.0:1790096857.521176:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273088 00010000:00010000:2.0:1790096857.521217:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.521259:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1790096857.521268:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+12:2362:x1877052305273088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096857.521284:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096857.521309:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.521323:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.521351:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab67df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382126c expref: 12 pid: 6695 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.521391:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.521395:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.521404:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.521414:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.521452:0:11191:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.521469:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11191:1877052324130560:192.168.203.11@tcp:105: 00000100:00100000:2.0:1790096857.524742:0:11191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790096857.534770:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11191:1877052324130560:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790096857.534796:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096857.534855:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2362:x1877052305273088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 13586us (13939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.534865:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1790096857.539837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.540631:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273216 00000100:00100000:3.0:1790096857.540693:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273216 00002000:00100000:3.0:1790096857.540747:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9eaaee585500 x1877052305273216/t0(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:173/0 lens 504/0 e 0 to 0 dl 1790096868 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096857.540759:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee585500 with x1877052305273216 ext(0->12) 00002000:00010000:3.0:1790096857.540780:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee585500 00000100:00100000:3.0:1790096857.540818:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790096857.540827:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+11:2363:x1877052305273216:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790096857.541275:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+13:2363:x1877052305273216:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 446us (1445us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790096857.541283:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00002000:00100000:3.0:1790096857.541291:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9eaaee585500 x1877052305273216/t4294967320(0) o4->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:173/0 lens 504/448 e 0 to 0 dl 1790096868 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790096857.541298:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaee585500 with x1877052305273216 ext(0->12) 00002000:00010000:3.0:1790096857.541301:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaee585500 00000100:00100000:3.0:1790096857.548188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.548830:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273344 00000100:00100000:0.0:1790096857.548841:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273344 00000100:00100000:0.0:1790096857.548916:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:0.0:1790096857.548927:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+66:11615:x1877052305273344:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790096857.583151:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:0.0:1790096857.583172:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1790096857.583191:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1790096857.583196:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1790096857.583221:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaad1a2ccc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790096857.583226:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaaeefcf500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaad1a2c780 00000020:00080000:0.0:1790096857.583229:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaaeefcff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaad4525400 00000001:00080000:0.0:1790096857.583242:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:0.0:1790096857.583254:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaaffea3780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790096857.583256:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac9651400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaaffea3f00 00000020:00080000:0.0:1790096857.583259:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaac9651600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaac7ff4400 00000004:00080000:0.0:1790096857.583286:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:0.0:1790096857.583475:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324130688:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1790096857.583854:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1790096857.584030:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790096857.584048:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324130816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790096857.584137:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11615:x1877052305273344:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 35207us (35956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.584150:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:0.0:1790096857.585104:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096857.585157:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324130944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790096857.585193:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096857.585290:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324130688 00000100:00100000:1.0:1790096857.585298:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324130688 00000100:00100000:1.0:1790096857.585340:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324130944 00000100:00100000:1.0:1790096857.585343:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324130944 00000100:00100000:1.0:1790096857.585378:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790096857.585387:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324130688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790096857.585430:0:7012:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1790096857.585478:0:7012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2b5d8, atime: 0x6ab2b5d8, ctime: 0x6ab2b5d8, blocks: 0xb 00010000:00010000:1.0:1790096857.585486:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.585503:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1790096857.585508:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096857.585525:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.585542:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.585552:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.585561:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.585578:0:7012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790096857.586132:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324130688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 744us (1030us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790096857.586141:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790096857.586285:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790096857.586294:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1877052324130944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790096857.586400:0:7012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790096857.586409:0:7012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790096857 00002000:00010000:1.0:1790096857.586412:0:7012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790096857.586414:0:7012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790096857 -> 1790096857 00002000:00010000:1.0:1790096857.586416:0:7012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790096857.586448:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1877052324130944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (1253us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1790096857.586454:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1790096857.586478:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790096857.586488:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096857.586494:0:7651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.586505:0:7651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096857.586510:0:7651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.586519:0:7651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.586537:0:7651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.586545:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab67ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.586562:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096857.586564:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096857.586565:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790096857.587055:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaafbaa8000/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790096857.587064:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324130944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790096857.587090:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790096857.587095:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:0.0:1790096857.587113:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaeef3ce00, transno 4294967307 00000004:00080000:0.0:1790096857.587130:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1790096857.587144:0:3315:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9eaafbaaa680 x1877052324130688/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790096873 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790096857.587161:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaafbaaa680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1790096857.587166:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324130688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790096857.592430:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096857.592882:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324130816 00000100:00100000:1.0:1790096857.592893:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324130816 00000100:00100000:1.0:1790096857.592946:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790096857.592956:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1877052324130816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790096857.592985:0:7012:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1790096857.593008:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.593029:0:7012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.593037:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790096857.593042:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096857.593046:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.593080:0:7012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.593094:0:7012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 12 pid: 6696 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.593108:0:7012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324131072:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096857.593193:0:7012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb705240 going to sleep for 11 seconds 00000100:00100000:1.0:1790096857.593242:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.593589:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273472 00000100:00100000:3.0:1790096857.593595:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273472 00000100:00100000:3.0:1790096857.593627:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1790096857.593661:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+13:2362:x1877052305273472:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790096857.605234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.605270:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273600 00000100:00100000:2.0:1790096857.605294:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273600 00010000:00010000:2.0:1790096857.605336:0:8472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 14 pid: 6696 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.605378:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:2.0:1790096857.605389:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2363:x1877052305273600:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096857.605403:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096857.605409:0:8472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 14 pid: 6696 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605423:0:8472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 14 pid: 6696 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605461:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096857.605467:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096857.605473:0:8472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605483:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605505:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096857.605561:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+14:2363:x1877052305273600:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 174us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.605568:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00010000:00010000:2.0:1790096857.605710:0:7012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dcc3e29/0xcc97d9eae5ab65af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211d2 expref: 13 pid: 6696 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.605737:0:7012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324131072:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096857.605761:0:7012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605770:0:7012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605776:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605785:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605792:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.605808:0:7012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790096857.606346:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1877052324130816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13389us (13920us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790096857.606355:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1790096857.606380:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096857.606387:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.606409:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096857.606413:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.606422:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.606438:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.606446:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd9842a/0xcc97d9eae5ab67f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.606464:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096857.606466:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096857.606468:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790096857.606495:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaafbaaaa00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1790096857.606502:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324130816:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790096857.661696:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790096857.673807:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1790096857.673834:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1790096857.673852:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1790096857.674429:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2362:x1877052305273472:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 80468us (80860us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.674457:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1790096857.685041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.685422:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273856 00000100:00100000:0.0:1790096857.685433:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273856 00000100:00100000:0.0:1790096857.685492:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:0.0:1790096857.685503:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11615:x1877052305273856:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096857.685566:0:7513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096857.685591:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab67d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821265 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.685611:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:0.0:1790096857.685617:0:7513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096857.685715:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.685730:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.685739:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096857.686018:0:7513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091bd9890 reply state 00000000be571f7c transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.686046:0:7513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096857.686169:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+21:11615:x1877052305273856:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 667us (1137us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790096857.686176:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00010000:00010000:0.0:1790096857.689683:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689703:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689711:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689717:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.689722:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689729:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689746:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:0.0:1790096857.689750:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096857.689755:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.689925:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab67fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.697714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096857.697806:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305273984 00000100:00100000:3.0:1790096857.697816:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305273984 00000100:00100000:3.0:1790096857.697873:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1790096857.697884:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305273984:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790096857.698089:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790096857.698093:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790096857 -> 1790096856 00002000:00010000:3.0:1790096857.698096:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790096856 00002000:00010000:3.0:1790096857.698108:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790096857 -> 1790096856 00002000:00010000:3.0:1790096857.698110:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790096857.698179:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305273984:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 297us (476us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790096857.698199:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1790096857.704938:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.705191:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305274240 00000100:00100000:0.0:1790096857.705216:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305274240 00000100:00100000:0.0:1790096857.705285:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:0.0:1790096857.705296:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+20:11615:x1877052305274240:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790096857.705365:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.705381:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.705389:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.705426:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.705440:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 20 pid: 5853 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.705454:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324131200:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096857.705565:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d000 going to sleep for 11 seconds 00000100:00100000:0.0:1790096857.716993:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324131200:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096857.717027:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096857.726283:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.726392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305274368 00000100:00100000:1.0:1790096857.726403:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305274368 00010000:00010000:1.0:1790096857.726494:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 21 pid: 5853 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.726538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1790096857.726549:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:2362:x1877052305274368:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096857.726565:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096857.726572:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 21 pid: 5853 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726586:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 21 pid: 5853 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726607:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab67bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821257 expref: 21 pid: 5853 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726624:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:1.0:1790096857.726629:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726695:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726703:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.726749:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096857.726804:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:2362:x1877052305274368:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 256us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.726812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00010000:00010000:0.0:1790096857.727072:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727082:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727122:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727131:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727138:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727144:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.727148:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727155:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727165:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:0.0:1790096857.727169:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790096857.727173:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.727179:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691800/0xcc97d9eae5ab6802 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.727234:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11615:x1877052305274240:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 21940us (22306us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790096857.727242:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:3.0:1790096857.741151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.742022:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305274496 00000100:00100000:2.0:1790096857.742034:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305274496 00000100:00100000:2.0:1790096857.742101:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1790096857.742113:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2363:x1877052305274496:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790096857.742157:0:7012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.742197:0:7012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.742206:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096857.742211:0:7012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790096857.742215:0:7012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.742249:0:7012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.742262:0:7012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 8 pid: 6694 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.742275:0:7012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324131328:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790096857.742357:0:7012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096857.746267:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.746400:0:7012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7012:1877052324131328:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790096857.746437:0:7012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096857.746517:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305274624 00000100:00100000:3.0:1790096857.746524:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305274624 00010000:00010000:3.0:1790096857.746573:0:11191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 9 pid: 6694 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096857.746612:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1790096857.746622:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+9:2362:x1877052305274624:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096857.746688:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096857.746710:0:11191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 9 pid: 6694 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.746723:0:11191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 9 pid: 6694 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.746747:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c2f12f/0xcc97d9eae5ab67e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821273 expref: 9 pid: 6694 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.746763:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096857.746768:0:11191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096857.746773:0:11191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.746806:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096857.746883:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096857.746940:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2362:x1877052305274624:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 319us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096857.746948:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00010000:00010000:1.0:1790096857.750254:0:7012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750274:0:7012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750312:0:7012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750321:0:7012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750330:0:7012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750338:0:7012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096857.750343:0:7012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750353:0:7012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750392:0:7012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.750403:0:7012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6809 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.751027:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305274496:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 8910us (9879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.751049:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1790096857.754795:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.755719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305274880 00000100:00100000:0.0:1790096857.755732:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305274880 00000100:00100000:0.0:1790096857.755809:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:0.0:1790096857.755819:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11615:x1877052305274880:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790096857.755901:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.755919:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.755932:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.756132:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.756144:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 20 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.756152:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.756259:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 20 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.756275:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 20 pid: 8484 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.756311:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324131456:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096857.756406:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d000 going to sleep for 11 seconds 00000100:00100000:0.0:1790096857.761423:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324131456:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096857.761451:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.764259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.768161:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305275008 00000100:00100000:2.0:1790096857.768175:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305275008 00010000:00010000:2.0:1790096857.768226:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 21 pid: 8484 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096857.768291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1790096857.768302:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:2362:x1877052305275008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096857.768317:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096857.768324:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 21 pid: 8484 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768337:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 21 pid: 8484 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768359:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7600/0xcc97d9eae5ab67ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382125e expref: 21 pid: 8484 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768376:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:2.0:1790096857.768382:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768392:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768400:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.768421:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096857.769463:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+20:2362:x1877052305275008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1155us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.769474:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00010000:00010000:0.0:1790096857.770293:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.770307:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790096857.770497:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790096857.770700:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1790096857.770745:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790096857.770828:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324131584:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790096857.770885:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096857.770919:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790096857.771367:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324131584 00000100:00100000:2.0:1790096857.771387:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324131584 00000100:00100000:2.0:1790096857.771425:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790096857.771434:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1877052324131584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790096857.771719:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1877052324131584:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.771728:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096857.772128:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1790096857.772134:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1790096857.772156:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaafbaa8000, transno 4294967321 00000100:00100000:0.0:1790096857.772178:0:5851:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9eaafbaaaa00 x1877052324130816/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790096873 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096857.772191:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324131584:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790096857.773841:0:5851:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1790096857.773918:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324131712:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790096857.773986:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096857.774024:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d000 going to sleep for 11 seconds 00000100:00100000:2.0:1790096857.774149:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324131712 00000100:00100000:2.0:1790096857.774158:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324131712 00000100:00100000:2.0:1790096857.774199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096857.774207:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1877052324131712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790096857.774389:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5851:x1877052324131712:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (401us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790096857.774397:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096857.777906:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbaabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1877052324131712:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790096857.777957:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.777967:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.777974:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.777980:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.777985:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.777993:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778008:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaac2c3c000) 00010000:00010000:0.0:1790096857.778011:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790096857.778016:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778022:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab6817 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778055:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778061:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778082:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778086:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.778089:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778095:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778103:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.778106:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790096857.778112:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778125:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778135:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.778178:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.778193:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324131840:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790096857.778418:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59d000 going to sleep for 11 seconds 00000100:00100000:2.0:1790096857.782935:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1877052324131840:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790096857.782966:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.782977:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab675a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783010:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783025:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783036:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783047:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783068:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783075:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783081:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096857.783085:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783093:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783104:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.783107:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096857.783111:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783117:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9400/0xcc97d9eae5ab681e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783127:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783133:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783139:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783144:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096857.783154:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783161:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783169:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096857.783172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790096857.783175:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096857.783180:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096857.783550:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096857.783556:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096857.784056:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790096857.784064:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790096857.784232:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11615:x1877052305274880:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 28411us (29443us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1790096857.784244:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 229 00000020:00080000:2.0:1790096857.784250:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790096857.788825:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.788952:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305275136 00000100:00100000:0.0:1790096857.788962:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305275136 00000100:00100000:0.0:1790096857.789020:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1790096857.789029:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11614:x1877052305275136:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:0.0:1790096857.789135:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11614:x1877052305275136:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.789142:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790096857.798788:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.798871:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305275392 00000100:00100000:0.0:1790096857.798882:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305275392 00000100:00100000:0.0:1790096857.798928:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1790096857.798938:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac378ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+23:11615:x1877052305275392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790096857.799607:0:5855:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790096857.799740:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1790096857.799782:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799799:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799811:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799819:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799825:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799831:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.799849:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790096857.800208:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096857.800216:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.800223:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096857.800227:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.800235:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.800247:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eaad43d3800) 00010000:00010000:1.0:1790096857.800250:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790096857.800254:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.800273:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab6825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.800291:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096857.800292:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096857.800294:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096857.808256:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac378ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11615:x1877052305275392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 9307us (9464us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790096857.808271:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:0.0:1790096857.808278:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790096857.808555:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.809079:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305275648 00000100:00100000:0.0:1790096857.809088:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305275648 00000100:00100000:0.0:1790096857.809142:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:0.0:1790096857.809151:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11614:x1877052305275648:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:0.0:1790096857.809409:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790096857.809481:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11614:x1877052305275648:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 330us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.809489:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:1.0:1790096857.843499:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096857.843671:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305275776 00000100:00100000:0.0:1790096857.843682:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305275776 00000100:00100000:0.0:1790096857.843744:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:0.0:1790096857.843754:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+25:11617:x1877052305275776:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790096857.843782:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096857.843803:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab682c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382127a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843864:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843879:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843888:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843922:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843930:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.843937:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.844172:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.844187:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.844195:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.844227:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.844241:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 26 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096857.844255:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324131968:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790096857.844340:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096857.850760:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1877052324131968:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790096857.850790:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.851706:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096857.852007:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276032 00000100:00100000:2.0:1790096857.852015:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276032 00000100:00100000:2.0:1790096857.852073:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790096857.852083:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+27:5598:x1877052305276032:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790096857.852320:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+28:5598:x1877052305276032:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 237us (617us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790096857.852328:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790096857.858495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096857.858681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276160 00000100:00100000:1.0:1790096857.858692:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276160 00010000:00010000:1.0:1790096857.858735:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 28 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096857.858777:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:1.0:1790096857.858787:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:2362:x1877052305276160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096857.858802:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096857.858809:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 28 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858822:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 28 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858847:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690200/0xcc97d9eae5ab674c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382123b expref: 28 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858863:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096857.858883:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858893:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858902:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096857.858925:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096857.858987:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+27:2362:x1877052305276160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 201us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.858995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00010000:00010000:0.0:1790096857.859070:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859079:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096857.859118:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790096857.859122:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096857.859143:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859156:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859166:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859173:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859180:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859185:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.859190:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859197:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859206:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:0.0:1790096857.859215:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096857.859220:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859226:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690a00/0xcc97d9eae5ab6833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859238:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859245:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859251:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859256:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096857.859259:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859265:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859271:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eaad43d3e00) 00010000:00010000:0.0:1790096857.859273:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096857.859276:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859281:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691e00/0xcc97d9eae5ab683a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859315:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab682c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382127a expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859341:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382127a expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096857.859348:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096857.859350:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096857.859352:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691600, rc 0) 00000100:00100000:0.0:1790096857.859378:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11617:x1877052305275776:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 15627us (15891us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096857.859385:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:2.0:1790096857.981431:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324132480:0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.981533:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096857.981597:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790096857.981619:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324132352:0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.981688:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096857.981721:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132480 00000100:00100000:2.0:1790096857.981729:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132480 00000100:00080000:2.0:1790096857.981754:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096857.981792:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132352 00000100:00100000:2.0:1790096857.981796:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132352 00000100:00100000:2.0:1790096857.981822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790096857.981831:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.981882:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324132480:12345-0@lo:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.981889:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790096857.981906:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790096857.981912:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.981938:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324132352:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.981943:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1790096857.981956:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096857.981983:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324132352:0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.981993:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324132480:0@lo:400:kworker.0 00000100:00100000:3.0:1790096857.982345:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324132224:0@lo:400:kworker.0 00000100:00100000:3.0:1790096857.982372:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096857.982395:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096857.982398:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324132096:0@lo:400:kworker.0 00000100:00100000:3.0:1790096857.982418:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096857.982492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132096 00000100:00100000:1.0:1790096857.982506:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132096 00000100:00100000:1.0:1790096857.982546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790096857.982553:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324132096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096857.982592:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3315:x1877052324132096:12345-0@lo:400:kworker.0 Request processed in 39us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096857.982597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790096857.982663:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324132096:0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.983025:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132224 00000100:00100000:2.0:1790096857.983030:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132224 00000100:00100000:2.0:1790096857.983067:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790096857.983074:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096857.983111:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324132224:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096857.983130:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790096857.984121:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324132224:0@lo:400:kworker.0 00000100:00100000:3.0:1790096858.283419:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096858.283479:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096858.283518:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096858.283739:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276288 00000100:00100000:2.0:1790096858.283749:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276288 00000100:00100000:2.0:1790096858.283811:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:2.0:1790096858.283823:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305276288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096858.283901:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305276288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096858.283908:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:2.0:1790096858.283940:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276544 00000100:00100000:2.0:1790096858.283944:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276544 00000100:00100000:2.0:1790096858.283983:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:2.0:1790096858.283989:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305276544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096858.284018:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305276544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096858.284024:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00080000:2.0:1790096858.284152:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096858.285252:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276416 00000100:00100000:1.0:1790096858.285261:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276416 00000100:00100000:1.0:1790096858.285324:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:1.0:1790096858.285333:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305276416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096858.285401:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305276416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096858.285423:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00080000:2.0:1790096858.286021:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096858.493131:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096858.493309:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324132608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096858.493378:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096858.493918:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132608 00000100:00100000:3.0:1790096858.493929:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132608 00000100:00100000:3.0:1790096858.494017:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790096858.494029:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324132608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790096858.494072:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096858.494137:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877052324132608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096858.494144:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1790096858.494214:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096858.494276:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324132608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096858.694923:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096858.779344:0:12584:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096858.779354:0:12584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096858.779403:0:12584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790096858.779410:0:12584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790096858.814057:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790096858.814066:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790096858.814113:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790096858.814119:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790096858.814235:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324132736:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790096858.814331:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaff59de40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096858.825548:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1877052324132736:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790096858.832521:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096858.832591:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276672 00000100:00100000:1.0:1790096858.832601:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276672 00000100:00100000:1.0:1790096858.832696:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:1.0:1790096858.832708:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11628:x1877052305276672:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790096858.832741:0:5853:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790096858.832847:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11628:x1877052305276672:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 141us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096858.832854:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00080000:0.0:1790096858.833298:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096858.847214:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096858.847296:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305276928 00000100:00100000:2.0:1790096858.847308:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305276928 00000100:00100000:2.0:1790096858.847375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:2.0:1790096858.847386:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+26:11628:x1877052305276928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096858.847407:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096858.847430:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6848 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821281 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096858.847539:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab684f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096858.847556:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096858.847570:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096858.847583:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790096858.847759:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8e00/0xcc97d9eae5ab6848 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821281 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096858.847781:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab684f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821281 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096858.847790:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096858.847793:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790096858.847797:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9000, rc 0) 00000100:00100000:2.0:1790096858.847861:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11628:x1877052305276928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 477us (660us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790096858.847869:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:2.0:1790096858.856783:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096858.857105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096858.857325:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305277056 00000100:00100000:3.0:1790096858.857336:0:8472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305277056 00000100:00100000:3.0:1790096858.857404:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790096858.857414:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+28:2360:x1877052305277056:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096858.857430:0:8472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096858.857459:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db9000/0xcc97d9eae5ab684f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821281 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096858.857478:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096858.857484:0:8472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096858.857551:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+27:2360:x1877052305277056:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 138us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096858.857559:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790096858.858220:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305277312 00000100:00100000:0.0:1790096858.858228:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305277312 00000100:00100000:0.0:1790096858.858317:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:0.0:1790096858.858325:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+27:11628:x1877052305277312:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790096858.858396:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858425:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858436:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858668:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858677:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858684:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858690:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096858.858694:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858701:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858712:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:0.0:1790096858.858714:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790096858.858719:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096858.858725:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691200/0xcc97d9eae5ab685d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790096858.858999:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096858.859015:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096858.859485:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790096858.859492:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790096858.859718:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11628:x1877052305277312:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 1390us (2610us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790096858.859737:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:2.0:1790096858.862492:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096858.862602:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305277568 00000100:00100000:1.0:1790096858.862611:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305277568 00000100:00100000:1.0:1790096858.862699:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1790096858.862709:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+28:11628:x1877052305277568:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790096858.862934:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11628:x1877052305277568:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 225us (450us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790096858.862942:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00010000:00010000:2.0:1790096859.710251:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096860.734967:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790096860.838339:0:12636:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096860.838348:0:12636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096860.838389:0:12636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790096860.838394:0:12636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790096861.056317:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324132864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096861.056402:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096861.056616:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132864 00000100:00100000:3.0:1790096861.056624:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132864 00000100:00100000:3.0:1790096861.056706:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790096861.056716:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf4093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324132864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790096861.056753:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790096861.056799:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf4093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324132864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096861.056806:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790096861.057088:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096861.057841:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324132864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096861.090560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096861.090685:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305277824 00000100:00100000:1.0:1790096861.090696:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305277824 00000100:00100000:1.0:1790096861.090759:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:1.0:1790096861.090770:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+29:11650:x1877052305277824:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096861.090791:0:8484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096861.090810:0:8484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab6864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821288 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.090904:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab686b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.090917:0:8484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab686b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.090929:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab686b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096861.090939:0:8484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790096861.091059:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148fe00/0xcc97d9eae5ab6864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821288 expref: 32 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.091077:0:8484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab686b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821288 expref: 31 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.091086:0:8484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:1.0:1790096861.091089:0:8484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790096861.091092:0:8484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f800, rc 0) 00000100:00100000:1.0:1790096861.091161:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11650:x1877052305277824:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 393us (610us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790096861.091180:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00080000:0.0:1790096861.091303:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096861.094750:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096861.094842:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305277952 00000100:00100000:2.0:1790096861.094851:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305277952 00000100:00100000:2.0:1790096861.094904:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:2.0:1790096861.094913:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11650:x1877052305277952:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790096861.094976:0:7513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.094993:0:7513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095005:0:7513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095040:0:7513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095048:0:7513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095055:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095080:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096861.095085:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095092:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095105:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:2.0:1790096861.095108:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096861.095113:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096861.095119:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8600/0xcc97d9eae5ab6879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096861.095207:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+31:11650:x1877052305277952:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 294us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096861.095215:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:3.0:1790096861.232352:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096861.232496:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278080 00000100:00100000:1.0:1790096861.232506:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278080 00000100:00080000:0.0:1790096861.232682:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096861.232829:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790096861.232842:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2361:x1877052305278080:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1790096861.232861:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096861.232881:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6880 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382128f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790096861.232906:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6ab2b5d8, atime: 0x6ab2b5d8, ctime: 0x6ab2b5d8, blocks: 0xb 00010000:00010000:1.0:1790096861.232924:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1790096861.232928:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096861.232937:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382128f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.232955:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382128f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096861.232967:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fe00, rc 0) 00000100:00100000:1.0:1790096861.233036:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2361:x1877052305278080:12345-192.168.203.11@tcp:101:cat.0 Request processed in 197us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096861.233043:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1790096861.240243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096861.240393:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278208 00000100:00100000:2.0:1790096861.240402:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278208 00002000:00100000:2.0:1790096861.240458:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9eaaff0c0700 x1877052305278208/t0(0) o3->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:177/0 lens 488/0 e 0 to 0 dl 1790096872 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096861.240469:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaff0c0700 with x1877052305278208 ext(0->4095) 00002000:00010000:2.0:1790096861.240475:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaff0c0700 00000100:00100000:2.0:1790096861.240509:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790096861.240518:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305278208:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:2.0:1790096861.240885:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+8:2360:x1877052305278208:12345-192.168.203.11@tcp:3:cat.0 Request processed in 366us (651us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790096861.240907:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00002000:00100000:2.0:1790096861.240915:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9eaaff0c0700 x1877052305278208/t0(0) o3->7428525e-2b7d-490f-8a81-8b717b826fb3@192.168.203.11@tcp:177/0 lens 488/4536 e 0 to 0 dl 1790096872 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790096861.240923:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eaaff0c0700 with x1877052305278208 ext(0->4095) 00002000:00010000:2.0:1790096861.240926:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eaaff0c0700 00010000:00010000:1.0:1790096861.756839:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790096862.152888:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1790096862.653448:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1790096862.653572:0:12493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eaaff59d300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790096862.653577:0:12493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaad5635e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eaaff59d180 00000020:00080000:2.0:1790096862.653581:0:12493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eaad5635d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eaafb453000 00000001:00080000:2.0:1790096862.653609:0:12493:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1790096862.653624:0:12493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1790096862.653733:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1790096862.653910:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1790096862.782524:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096863.101162:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324133376:0@lo:400:kworker.0 00000100:00100000:1.0:1790096863.101236:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096863.101310:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096863.101315:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324133248:0@lo:400:kworker.0 00000100:00100000:1.0:1790096863.101343:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096863.101385:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133376 00000100:00100000:0.0:1790096863.101393:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133248 00000100:00100000:1.0:1790096863.101394:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133376 00000100:00100000:0.0:1790096863.101401:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133248 00000100:00100000:0.0:1790096863.101475:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790096863.101487:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324133248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096863.101525:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324133120:0@lo:400:kworker.0 00000100:00100000:0.0:1790096863.101553:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324133248:12345-0@lo:400:kworker.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096863.101564:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790096863.101567:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096863.101645:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324132992:0@lo:400:kworker.0 00000100:00100000:3.0:1790096863.101696:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324133632:0@lo:400:kworker.0 00000100:00100000:2.0:1790096863.108797:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096863.108862:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324133504:0@lo:400:kworker.0 00000100:00100000:2.0:1790096863.108898:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096863.108986:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133120 00000100:00100000:0.0:1790096863.108996:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133120 00000100:00100000:0.0:1790096863.109044:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790096863.109054:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324133120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096863.109108:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324133120:12345-0@lo:400:kworker.0 Request processed in 55us (7544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096863.109125:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1790096863.109190:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790096863.109197:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096863.109426:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790096863.109437:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096863.109479:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324133376:12345-0@lo:400:kworker.0 Request processed in 45us (8243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096863.109498:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790096863.109560:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324133248:0@lo:400:kworker.0 00000100:00100000:1.0:1790096863.109574:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324133376:0@lo:400:kworker.0 00000100:00100000:0.0:1790096863.110787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324132992 00000100:00100000:3.0:1790096863.110795:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096863.110798:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324132992 00000100:00100000:0.0:1790096863.110843:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790096863.110850:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324133120:0@lo:400:kworker.0 00000100:00100000:0.0:1790096863.110856:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324132992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096863.110908:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad0fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324132992:12345-0@lo:400:kworker.0 Request processed in 57us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096863.110916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790096863.112917:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133632 00000100:00100000:1.0:1790096863.112929:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133632 00000100:00100000:1.0:1790096863.113017:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790096863.113029:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096863.113135:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324133632:12345-0@lo:400:kworker.0 Request processed in 110us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096863.113141:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1790096863.113242:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790096863.113927:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790096863.113937:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaafbaaa680, transno 4294967310 00000100:00100000:0.0:1790096863.113953:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324133632:0@lo:400:kworker.0 00000100:00100000:2.0:1790096863.119006:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324132992:0@lo:400:kworker.0 00000100:00100000:3.0:1790096863.120545:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133504 00000100:00100000:3.0:1790096863.120557:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133504 00000100:00080000:0.0:1790096863.120609:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096863.120664:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790096863.120676:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324133504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096863.120765:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324133504:12345-0@lo:400:kworker.0 Request processed in 92us (11865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096863.120772:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790096863.120854:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324133504:0@lo:400:kworker.0 00000001:00080000:1.0:1790096863.170689:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1790096863.170707:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:3.0:1790096863.407419:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096863.407457:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096863.407497:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096863.407530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096863.407558:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096863.407589:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278848 00000100:00100000:3.0:1790096863.407612:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278848 00000100:00100000:3.0:1790096863.407704:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278464 00000100:00100000:3.0:1790096863.407708:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278464 00000100:00100000:3.0:1790096863.407731:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:3.0:1790096863.407741:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305278848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096863.407813:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+5:2360:x1877052305278848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096863.407820:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:3.0:1790096863.407837:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1790096863.407843:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2360:x1877052305278464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096863.407880:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2360:x1877052305278464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096863.407887:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1790096863.407906:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278592 00000100:00100000:3.0:1790096863.407909:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278592 00000100:00100000:3.0:1790096863.407935:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278720 00000100:00100000:3.0:1790096863.407938:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278720 00000100:00100000:3.0:1790096863.407959:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790096863.407965:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305278592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096863.407992:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2360:x1877052305278592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096863.407997:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790096863.408009:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1790096863.408016:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305278720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096863.408039:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2360:x1877052305278720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096863.408045:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00080000:3.0:1790096863.408060:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096863.408064:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096863.408067:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096863.408456:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278336 00000100:00100000:1.0:1790096863.408462:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278336 00000100:00100000:1.0:1790096863.408497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:1.0:1790096863.408504:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305278336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096863.408542:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2360:x1877052305278336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096863.408556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:0.0:1790096863.613053:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324133760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096863.613131:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096863.613266:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133760 00000100:00100000:1.0:1790096863.613274:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133760 00000100:00100000:1.0:1790096863.613335:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790096863.613345:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324133760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790096863.613379:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096863.613430:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324133760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096863.613436:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790096863.613493:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324133760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790096863.804814:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096864.828809:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096865.857981:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096866.176007:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324133888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096866.176077:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096866.176221:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324133888 00000100:00100000:1.0:1790096866.176229:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324133888 00000100:00100000:1.0:1790096866.176283:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790096866.176293:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324133888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096866.176342:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096866.176386:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324133888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096866.176393:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1790096866.176413:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096866.176437:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1790096866.176442:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaafbaaaa00, transno 4294967322 00000004:00080000:1.0:1790096866.176451:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1790096866.176477:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafbca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324133888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790096866.484196:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096866.484693:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305278976 00000100:00100000:1.0:1790096866.484707:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305278976 00000100:00100000:1.0:1790096866.484788:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:1.0:1790096866.484802:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11303:x1877052305278976:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790096866.484908:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11303:x1877052305278976:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 110us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096866.484916:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00080000:3.0:1790096866.485022:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096866.489913:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096866.489984:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279232 00000100:00100000:2.0:1790096866.489995:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279232 00000100:00100000:2.0:1790096866.490047:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790096866.490056:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:11303:x1877052305279232:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790096866.490452:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:11303:x1877052305279232:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 396us (546us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790096866.490460:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:2.0:1790096866.876738:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096867.069006:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790096867.069017:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096867.069285:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1790096867.069291:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1790096867.806096:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1790096867.806112:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1790096867.806830:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1790096867.806852:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1790096867.903630:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096868.221452:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324134400:0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.221545:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096868.221660:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096868.221667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324134272:0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.221699:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096868.221740:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134400 00000100:00100000:3.0:1790096868.221750:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134400 00000100:00100000:3.0:1790096868.221827:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790096868.221838:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.221899:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324134400:12345-0@lo:400:kworker.0 Request processed in 62us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096868.221908:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790096868.221940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134272 00000100:00100000:3.0:1790096868.221944:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134272 00000100:00100000:3.0:1790096868.221976:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790096868.221983:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324134272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.222015:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324134272:12345-0@lo:400:kworker.0 Request processed in 33us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096868.222022:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1790096868.222041:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790096868.222048:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096868.222089:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324134272:0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.222100:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324134400:0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.222964:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324134144:0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.223020:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096868.223195:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134144 00000100:00100000:0.0:1790096868.223203:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134144 00000100:00100000:0.0:1790096868.223249:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790096868.223258:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324134144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.223305:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324134144:12345-0@lo:400:kworker.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096868.223312:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790096868.223528:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324134016:0@lo:400:kworker.0 00000100:00100000:1.0:1790096868.223583:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096868.223618:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324134528:0@lo:400:kworker.0 00000100:00100000:1.0:1790096868.223662:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096868.223697:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134528 00000100:00100000:1.0:1790096868.223701:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134528 00000100:00100000:1.0:1790096868.223736:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790096868.223743:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096868.223796:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324134528:12345-0@lo:400:kworker.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096868.223802:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1790096868.223925:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096868.223995:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324134528:0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.224199:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324134144:0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.224209:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324134656:0@lo:400:kworker.0 00000100:00100000:0.0:1790096868.224241:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096868.224610:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134016 00000100:00100000:1.0:1790096868.224616:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134016 00000100:00100000:1.0:1790096868.224678:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790096868.224686:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096868.224737:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324134016:12345-0@lo:400:kworker.0 Request processed in 52us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096868.224761:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790096868.224928:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324134016:0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.239981:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134656 00000100:00100000:3.0:1790096868.240006:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134656 00000100:00100000:3.0:1790096868.240120:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790096868.240138:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096868.240283:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324134656:12345-0@lo:400:kworker.0 Request processed in 152us (16040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096868.240308:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790096868.240407:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324134656:0@lo:400:kworker.0 00000100:00080000:2.0:1790096868.240811:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790096868.527719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096868.530662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096868.530720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096868.530752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096868.531153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096868.531218:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279616 00000100:00100000:0.0:1790096868.531231:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279616 00000100:00100000:0.0:1790096868.531726:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279744 00000100:00100000:0.0:1790096868.531732:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279744 00000100:00100000:0.0:1790096868.531766:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:0.0:1790096868.531779:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305279616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096868.531893:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2363:x1877052305279616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 116us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096868.531903:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:0.0:1790096868.531928:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1790096868.531935:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305279744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096868.531964:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2363:x1877052305279744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096868.531971:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1790096868.531997:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279872 00000100:00100000:0.0:1790096868.532001:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279872 00000100:00100000:0.0:1790096868.532037:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279488 00000100:00100000:0.0:1790096868.532041:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279488 00000100:00080000:2.0:1790096868.532059:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790096868.532066:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096868.532068:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096868.534780:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:0.0:1790096868.534816:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305279872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096868.534955:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+5:2363:x1877052305279872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 157us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096868.534965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:2.0:1790096868.534984:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:2.0:1790096868.534997:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2363:x1877052305279488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096868.535039:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7428525e-2b7d-490f-8a81-8b717b826fb3+18:2363:x1877052305279488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 47us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096868.535046:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1790096868.537044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305279360 00000100:00100000:3.0:1790096868.537074:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305279360 00000100:00100000:3.0:1790096868.537155:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:3.0:1790096868.537167:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305279360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096868.537611:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2363:x1877052305279360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 443us (9904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096868.537620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:2.0:1790096868.733608:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096868.733672:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324134784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096868.733766:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096868.733875:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134784 00000100:00100000:2.0:1790096868.733895:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134784 00000100:00100000:2.0:1790096868.733967:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790096868.733978:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324134784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096868.734035:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096868.734089:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324134784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096868.734098:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790096868.734160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324134784:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1790096868.803539:0:12839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:07:46 (1790096866) 00010000:00010000:0.0:1790096868.925255:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096869.956475:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096870.973731:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096871.297369:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096871.297401:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096871.297498:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096871.297588:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324134912 00000100:00100000:1.0:1790096871.297598:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324134912 00000100:00100000:1.0:1790096871.297747:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790096871.297758:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324134912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096871.297807:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096871.297857:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324134912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096871.297864:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1790096871.297888:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096871.297934:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096871.422427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096871.422546:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305280000 00000100:00100000:3.0:1790096871.422557:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305280000 00000100:00100000:3.0:1790096871.422666:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:3.0:1790096871.422680:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+5:12315:x1877052305280000:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:3.0:1790096871.422703:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096871.422725:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821296 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422797:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422811:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422821:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096871.422857:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096871.422876:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096871.422922:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422946:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6200/0xcc97d9eae5ab6887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821296 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422964:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821296 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096871.422972:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:3.0:1790096871.422974:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096871.422978:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7a00, rc 0) 00000100:00100000:3.0:1790096871.423031:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56fd0760-a5ee-4811-af5a-739a392b530e+6:12315:x1877052305280000:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 353us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096871.423037:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00080000:1.0:1790096871.423338:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790096871.996878:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096872.924545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096872.924669:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305280256 00000100:00100000:2.0:1790096872.924682:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305280256 00000100:00100000:2.0:1790096872.924770:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1790096872.924783:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+18:12316:x1877052305280256:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1790096872.925152:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:12316:x1877052305280256:12345-192.168.203.11@tcp:35:umount.0 Request processed in 371us (615us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1790096872.925160:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:1.0:1790096872.925801:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096872.937069:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096872.937166:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305280512 00000100:00100000:0.0:1790096872.937176:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305280512 00000100:00100000:0.0:1790096872.937235:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1790096872.937245:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+19:12316:x1877052305280512:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:0.0:1790096872.937619:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:12316:x1877052305280512:12345-192.168.203.11@tcp:35:umount.0 Request processed in 374us (557us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1790096872.937628:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1790096872.945414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096872.948372:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305280768 00000100:00100000:2.0:1790096872.948389:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305280768 00000100:00100000:2.0:1790096872.948478:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1790096872.948489:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac3789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+20:12316:x1877052305280768:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1790096872.949394:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac3789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7428525e-2b7d-490f-8a81-8b717b826fb3+21:12316:x1877052305280768:12345-192.168.203.11@tcp:35:umount.0 Request processed in 901us (3984us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790096872.949405:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790096872.955180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096872.955292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281024 00000100:00100000:3.0:1790096872.955302:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281024 00000100:00100000:3.0:1790096872.955402:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1790096872.955419:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+21:12316:x1877052305281024:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:3.0:1790096872.955813:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+22:12316:x1877052305281024:12345-192.168.203.11@tcp:35:umount.0 Request processed in 395us (641us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790096872.955821:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790096872.959870:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096872.959909:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096872.959940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096872.960007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281152 00000100:00100000:1.0:1790096872.960017:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281152 00000100:00100000:1.0:1790096872.960077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281408 00000100:00100000:1.0:1790096872.960080:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281408 00000100:00100000:1.0:1790096872.960099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281280 00000100:00100000:1.0:1790096872.960102:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281280 00000100:00100000:1.0:1790096872.960118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096872.960128:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+15:2362:x1877052305281152:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096872.960163:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096872.960186:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690000/0xcc97d9eae5ab58b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e28 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096872.960204:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096872.960262:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+14:2362:x1877052305281152:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 134us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096872.960269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096872.960313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790096872.960319:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+13:2362:x1877052305281408:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096872.960327:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096872.960344:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab5afe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820ef3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096872.960353:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096872.960372:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:2362:x1877052305281408:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 53us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096872.960377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790096872.960390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790096872.960409:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2362:x1877052305281280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790096872.960417:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096872.960425:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1538200/0xcc97d9eae5ab587a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820df0 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096872.960434:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096872.960452:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2362:x1877052305281280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 57us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096872.960464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790096872.962131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096872.962198:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281536 00000100:00100000:1.0:1790096872.962206:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281536 00000100:00100000:1.0:1790096872.962271:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1790096872.962280:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2359:x1877052305281536:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:1.0:1790096872.962308:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5bec 00000100:00080000:1.0:1790096872.962317:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9eaac7fde800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790096872.962358:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1790096872.962626:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790096872.962701:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096872.964941:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7428525e-2b7d-490f-8a81-8b717b826fb3+2:2359:x1877052305281536:12345-192.168.203.11@tcp:9:umount.0 Request processed in 2652us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096872.964955:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1790096872.971258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096872.971807:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305281920 00000100:00100000:0.0:1790096872.971819:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305281920 00000100:00100000:0.0:1790096872.972431:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:0.0:1790096872.972450:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+7:2359:x1877052305281920:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:0.0:1790096872.972479:0:6694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5e54 00000020:00010000:0.0:1790096872.972487:0:6694:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eaac3de6800: total 0 00000100:00080000:0.0:1790096872.972491:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9eaac3de7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790096872.972558:0:6694:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790096872.972879:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7428525e-2b7d-490f-8a81-8b717b826fb3+5:2359:x1877052305281920:12345-192.168.203.11@tcp:9:umount.0 Request processed in 432us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096872.972888:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000020:00010000:3.0:1790096872.973199:0:5839:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eaac3de6800: total 0 00010000:00010000:3.0:1790096872.973231:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eaac3de6800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1790096872.973281:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6880 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382128f expref: 4 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.973328:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084173151/0xcc97d9eae5ab61f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c8 expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.973340:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eaac3de6800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1790096872.973349:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096872.973351:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096872.973352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790096872.978706:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096872.985715:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096872.985800:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305282944 00000100:00100000:0.0:1790096872.985810:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305282944 00000100:00100000:0.0:1790096872.985875:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:0.0:1790096872.985884:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+22:2359:x1877052305282944:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1790096872.985917:0:7513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5888 00000020:00010000:0.0:1790096872.985932:0:7513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eaaff214000: total 0 00000100:00080000:0.0:1790096872.985937:0:7513:0:(import.c:65:import_set_state_nolock()) ffff9eaaff216800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790096872.985963:0:7513:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1790096872.986329:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7428525e-2b7d-490f-8a81-8b717b826fb3+21:2359:x1877052305282944:12345-192.168.203.11@tcp:39:umount.0 Request processed in 444us (622us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790096872.986338:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000020:00010000:3.0:1790096872.986437:0:7651:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eaaff214000: total 0 00010000:00010000:3.0:1790096872.986474:0:7651:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eaaff214000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1790096872.986506:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096872.986510:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096872.986517:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17a800/0xcc97d9eae5ab61b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210b3 expref: 20 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986549:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096872.986552:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790096872.986556:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8a00/0xcc97d9eae5ab61db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210c1 expref: 19 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986570:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096872.986573:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096872.986577:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8691600/0xcc97d9eae5ab6841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382127a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986590:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:3.0:1790096872.986592:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096872.986604:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690600/0xcc97d9eae5ab6244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210dd expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986618:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:3.0:1790096872.986620:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790096872.986623:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17ac00/0xcc97d9eae5ab5eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820fef expref: 16 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986668:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaac2c3c400) 00010000:00010000:3.0:1790096872.986671:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096872.986675:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7800/0xcc97d9eae5ab5b52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f01 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986693:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eaac4e7a700) 00010000:00010000:3.0:1790096872.986696:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096872.986700:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac8690400/0xcc97d9eae5ab60d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382107b expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986715:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eaac4e7ac00) 00010000:00010000:3.0:1790096872.986718:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790096872.986721:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8800/0xcc97d9eae5ab5bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f1d expref: 13 pid: 7513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986735:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096872.986737:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790096872.986741:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f800/0xcc97d9eae5ab686b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821288 expref: 12 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986754:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096872.986762:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790096872.986766:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38210e4 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986782:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096872.986784:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096872.986787:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaafb17b400/0xcc97d9eae5ab5b6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820f08 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986800:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eaac2c3c600) 00010000:00010000:3.0:1790096872.986803:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790096872.986806:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6600/0xcc97d9eae5ab653f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38211b6 expref: 9 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986820:0:7651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eaac4db7500) 00010000:00010000:3.0:1790096872.986822:0:7651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096872.986826:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaae8db8000/0xcc97d9eae5ab6761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821242 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096872.986836:0:7651:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eaaff214000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1790096872.986849:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096872.986852:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096872.986854:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096873.021339:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096873.341950:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324135296:0@lo:400:kworker.0 00000100:00100000:1.0:1790096873.342024:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096873.342079:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096873.342084:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324135424:0@lo:400:kworker.0 00000100:00100000:1.0:1790096873.342105:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096873.342435:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324135040:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342469:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096873.342495:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324135552:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096873.342540:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790096873.342546:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324135168:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342565:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096873.342583:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324135680:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342601:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096873.342629:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135424 00000100:00100000:0.0:1790096873.342657:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135424 00000100:00100000:0.0:1790096873.342709:0:7012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135680 00000100:00100000:0.0:1790096873.342713:0:7012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135680 00000100:00100000:0.0:1790096873.342737:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790096873.342746:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324135424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342793:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324135424:12345-0@lo:400:kworker.0 Request processed in 48us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.342815:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790096873.342836:0:7012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790096873.342842:0:7012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324135680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.342875:0:7012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324135680:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.342896:0:7012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790096873.342919:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135296 00000100:00100000:0.0:1790096873.342923:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135296 00000100:00100000:0.0:1790096873.342946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135552 00000100:00100000:0.0:1790096873.342949:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135552 00000100:00100000:0.0:1790096873.342965:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135168 00000100:00100000:0.0:1790096873.342968:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135168 00000100:00100000:0.0:1790096873.342980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790096873.342985:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324135296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343016:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324135296:12345-0@lo:400:kworker.0 Request processed in 31us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.343023:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790096873.343035:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790096873.343040:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343068:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324135552:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.343073:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790096873.343084:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790096873.343089:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343251:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad03ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324135168:12345-0@lo:400:kworker.0 Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.343267:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790096873.343313:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324135168:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343321:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324135680:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343329:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324135552:0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135040 00000100:00100000:0.0:1790096873.343399:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135040 00000100:00100000:0.0:1790096873.343421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790096873.343426:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096873.343461:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5700c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324135040:12345-0@lo:400:kworker.0 Request processed in 35us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096873.343467:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790096873.343495:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324135040:0@lo:400:kworker.0 00000100:00100000:1.0:1790096873.343750:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324135424:0@lo:400:kworker.0 00000100:00100000:1.0:1790096873.343759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324135296:0@lo:400:kworker.0 00000100:00080000:3.0:1790096873.344293:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790096873.344298:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096873.344300:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1790096873.374917:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:0.0:1790096873.374928:0:6721:0:(genops.c:885:class_export_put()) final put ffff9eaac3de6800/7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:1.0:1790096873.374984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac3de6800/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-OST0000 00000020:00000080:1.0:1790096873.375032:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaac3de7000 for lustre-OST0000 00000100:00100000:0.0:1790096873.644798:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096873.644894:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283072 00000100:00100000:2.0:1790096873.644904:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283072 00000100:00100000:2.0:1790096873.644973:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:2.0:1790096873.644982:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:2363:x1877052305283072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096873.645057:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56fd0760-a5ee-4811-af5a-739a392b530e+6:2363:x1877052305283072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096873.645064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00080000:3.0:1790096873.646212:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096873.854177:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324135808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096873.854254:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096873.854530:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135808 00000100:00100000:2.0:1790096873.854539:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135808 00000100:00100000:2.0:1790096873.854590:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790096873.854601:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324135808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096873.854654:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096873.854713:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324135808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096873.854720:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790096873.854807:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324135808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790096874.044888:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096875.020040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096875.020103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096875.020146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096875.020234:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283200 00000100:00100000:0.0:1790096875.020244:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283200 00000100:00100000:0.0:1790096875.020308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283456 00000100:00100000:0.0:1790096875.020311:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283456 00000100:00100000:0.0:1790096875.020333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283328 00000100:00100000:0.0:1790096875.020336:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283328 00000100:00100000:0.0:1790096875.020354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1790096875.020365:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+12:2361:x1877052305283200:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096875.020380:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096875.020420:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17be00/0xcc97d9eae5ab595a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e3d expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096875.020438:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096875.020492:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+11:2361:x1877052305283200:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096875.020500:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1790096875.020737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096875.020745:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+10:2361:x1877052305283456:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096875.020753:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096875.020763:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db9200/0xcc97d9eae5ab5af7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820eec expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096875.020774:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096875.020791:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+9:2361:x1877052305283456:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 48us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096875.020797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096875.020811:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1790096875.020817:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+8:2361:x1877052305283328:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096875.020825:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096875.020835:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f000/0xcc97d9eae5ab5961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e67 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096875.020844:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096875.020860:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd903c2-2249-402d-8b70-05d1ccf7fe60+7:2361:x1877052305283328:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 44us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096875.020867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1790096875.030359:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096875.030417:0:7513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283712 00000100:00100000:0.0:1790096875.030427:0:7513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283712 00000100:00100000:0.0:1790096875.030505:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:0.0:1790096875.030526:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeeffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+6:2359:x1877052305283712:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1790096875.030566:0:7513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab596f 00000020:00010000:0.0:1790096875.030575:0:7513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eaac3097800: total 0 00000100:00080000:0.0:1790096875.030580:0:7513:0:(import.c:65:import_set_state_nolock()) ffff9eaaff321800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790096875.030609:0:7513:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1790096875.030710:0:5839:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eaac3097800: total 0 00010000:00010000:2.0:1790096875.030755:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eaac3097800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790096875.030789:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac3cb7e00) 00010000:00010000:2.0:1790096875.030793:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096875.030803:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7a00/0xcc97d9eae5ab688e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821296 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096875.030827:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eaac3097800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790096875.030839:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.030841:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.030857:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096875.030871:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeeffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56fd0760-a5ee-4811-af5a-739a392b530e+3:2359:x1877052305283712:12345-192.168.203.11@tcp:39:umount.0 Request processed in 347us (521us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790096875.030880:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00080000:3.0:1790096875.031105:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096875.068563:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096875.068666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305283968 00000100:00100000:3.0:1790096875.068677:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305283968 00000100:00100000:3.0:1790096875.068741:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:3.0:1790096875.068752:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+7:2359:x1877052305283968:12345-192.168.203.11@tcp:251:umount.0 00000020:00000080:3.0:1790096875.068798:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5865 00000020:00010000:3.0:1790096875.068806:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eaafb3c7000: total 0 00000100:00080000:3.0:1790096875.068810:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9eaafb3c1800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790096875.068879:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5701050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd903c2-2249-402d-8b70-05d1ccf7fe60+3:2359:x1877052305283968:12345-192.168.203.11@tcp:251:umount.0 Request processed in 129us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096875.068887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 301 00000020:00010000:2.0:1790096875.069068:0:7651:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eaafb3c7000: total 0 00010000:00010000:2.0:1790096875.069073:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.069115:0:7651:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eaafb3c7000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790096875.069149:0:7651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539a00/0xcc97d9eae5ab58b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3820e2f expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096875.069165:0:7651:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eaafb3c7000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790096875.069174:0:7651:0:(genops.c:885:class_export_put()) final put ffff9eaafb3c7000/abd903c2-2249-402d-8b70-05d1ccf7fe60 00010000:00010000:2.0:1790096875.069195:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.069197:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.069198:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096875.069231:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790096875.069248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafb3c7000/abd903c2-2249-402d-8b70-05d1ccf7fe60 for MGS 00000020:00000080:0.0:1790096875.069300:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaafb3c1800 for MGS 00010000:00010000:2.0:1790096876.104254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096876.413113:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324135936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096876.413198:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096876.413272:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324135936 00000100:00100000:1.0:1790096876.413287:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324135936 00000100:00100000:1.0:1790096876.413390:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790096876.413401:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324135936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096876.413452:0:6698:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096876.413549:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324135936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096876.413556:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790096876.413625:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324135936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790096876.413795:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1790096876.965173:0:13036:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790096876.997093:0:13036:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790096876.997140:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096876.997154:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096876.997160:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096876.997167:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096876.997184:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790096876.997189:0:13036:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790096876.997211:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790096876.997228:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790096876.997234:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790096876.997275:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5ad800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1790096876.998787:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096876.998800:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.998812:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17a000 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096876.998816:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.998826:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096876.998834:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096876.998840:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790096876.998842:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790096876.998845:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790096876.998885:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.998902:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790096876.998938:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.998959:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17a000/0xcc97d9eae5ab58f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58ff expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.998979:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096876.998984:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096876.998988:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096876.999018:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324136064:0@lo:39:umount.0 00000100:00100000:3.0:1790096876.999089:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096876.999149:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136064 00000100:00100000:3.0:1790096876.999200:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324136192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096876.999229:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096876.999277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136192 00000100:00100000:3.0:1790096876.999285:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136192 00000100:00100000:3.0:1790096876.999360:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790096876.999372:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3316:x1877052324136192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096876.999386:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096876.999401:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539800/0xcc97d9eae5ab58ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab58f8 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096876.999415:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096876.999460:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3316:x1877052324136192:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096876.999468:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790096876.999547:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324136192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096876.999752:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136064 00000100:00100000:1.0:1790096876.999822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790096876.999834:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877052324136064:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790096876.999937:0:5852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5682 00000100:00080000:1.0:1790096876.999949:0:5852:0:(import.c:65:import_set_state_nolock()) ffff9eaaf3b2d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790096877.000081:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1877052324136064:12345-0@lo:39:umount.0 Request processed in 249us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096877.000088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790096877.000098:0:5852:0:(genops.c:885:class_export_put()) final put ffff9eaaca843800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1790096877.000128:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790096877.000130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaca843800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790096877.000214:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaf3b2d000 for lustre-MDT0000 00000100:00080000:3.0:1790096877.000338:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790096877.000398:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324136064:0@lo:39:umount.0 00000100:00080000:0.0:1790096877.000487:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790096877.000491:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790096877.000505:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790096877.003482:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003520:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003554:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003562:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003591:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096877.003599:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003607:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003613:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.003620:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.003700:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096877.003704:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096877.003729:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.003729:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.003763:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac0030000 already unused, calling callback (ffffffffc1a67c20) 00010000:00010000:2.0:1790096877.003765:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096877.003772:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096877.003774:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.003804:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.003807:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096877.003817:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096877.003825:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096877.003829:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1790096877.003830:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790096877.003878:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096877.003909:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.003909:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096877.003910:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096877.003922:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790096877.003923:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096877.003925:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790096877.003929:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790096877.003930:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.003973:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.003979:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790096877.003990:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324136320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096877.004006:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.004013:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac0030000/0xcc97d9eae5ab581f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.004035:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096877.004054:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096877.004056:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096877.004069:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324136448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096877.004076:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790096877.004153:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.004163:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1538e00/0xcc97d9eae5ab5906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab590d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.004181:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096877.004185:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096877.004202:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.004216:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096877.004224:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790096877.004230:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.004236:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.004244:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690800 already unused, calling callback (ffffffffc1a67c20) 00010000:00010000:0.0:1790096877.004254:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096877.004255:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.004300:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.004301:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096877.004342:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096877.004343:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096877.004368:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790096877.004371:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790096877.004374:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790096877.004376:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1790096877.004383:0:13036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790096877.004390:0:13036:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790096877.004426:0:13036:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790096877.004431:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790096877.004436:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096877.004442:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1790096877.004449:0:13036:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9eaaeef59000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096877.004455:0:13036:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9eaaff5d6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096877.004464:0:13036:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9eaac3097800 56fd0760-a5ee-4811-af5a-739a392b530e 192.168.203.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096877.004469:0:13036:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9eaaff214000 7428525e-2b7d-490f-8a81-8b717b826fb3 192.168.203.11@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1790096877.004485:0:13036:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9eaac580b380) has exports, disconnecting them 00000020:00080000:0.0:1790096877.004489:0:13036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eaaeef59000), last request at 1790096873 00000020:00000080:0.0:1790096877.004508:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab57e7 00000100:00080000:0.0:1790096877.004529:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaaeef5e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790096877.004588:0:13036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaaeef59000): rc 0 00000020:00000080:0.0:1790096877.004591:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaeef59000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790096877.004605:0:13036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eaaff5d6000), last request at 1790096873 00000020:00000080:0.0:1790096877.004608:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab571c 00000100:00080000:0.0:1790096877.004613:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790096877.004621:0:13036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaaff5d6000): rc 0 00000020:00000080:0.0:1790096877.004623:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaff5d6000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1790096877.004811:0:13036:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab9f41957ae0 00000100:00080000:0.0:1790096877.004849:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790096877.004854:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1790096877.004869:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790096877.004928:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790096877.004934:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790096877.004952:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaad0ebb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790096877.005017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136320 00000100:00100000:3.0:1790096877.005027:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136320 00000100:00080000:0.0:1790096877.005039:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790096877.005042:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1790096877.005052:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790096877.005113:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790096877.005124:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790096877.005207:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005218:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096877.005242:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005250:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac8690800/0xcc97d9eae5ab5b21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005264:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096877.005269:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005276:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1538400 already unused, calling callback (ffffffffc1a67c20) 00000020:00080000:0.0:1790096877.005284:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9eaac580b380) has no exports 10000000:00010000:2.0:1790096877.005294:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005304:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096877.005311:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096877.005316:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790096877.005318:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790096877.005321:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790096877.005341:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005349:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096877.005361:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005369:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1538400/0xcc97d9eae5ab55d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab55da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096877.005383:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096877.005385:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096877.005387:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790096877.005415:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaeef59000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1790096877.005560:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096877.005573:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324136960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096877.005618:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096877.005718:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136448 00000100:00100000:1.0:1790096877.005726:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136448 00000100:00100000:1.0:1790096877.005765:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136960 00000100:00100000:1.0:1790096877.005768:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136960 00000100:00100000:1.0:1790096877.005786:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790096877.005796:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac5cca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+20:3317:x1877052324136320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096877.005813:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096877.005842:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17ba00/0xcc97d9eae5ab590d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5906 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096877.005859:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1790096877.005870:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff5d6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1790096877.005909:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac5cca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3317:x1877052324136320:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1830us total) trans 0 rc 0/0 00000020:00000080:2.0:1790096877.005914:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaeef5e800 for lustre-MDT0000 00000020:00000080:2.0:1790096877.005923:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff5d0800 for lustre-MDT0000 00000100:00100000:3.0:1790096877.007313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096877.007335:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+19:3314:x1877052324136448:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096877.007343:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1790096877.007355:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096877.007377:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1486800/0xcc97d9eae5ab5826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab581f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096877.007418:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790096877.007426:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+18:3317:x1877052324136960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096877.007434:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096877.007444:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac0030400/0xcc97d9eae5ab55da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab55d3 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096877.007474:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096877.007542:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+17:3317:x1877052324136960:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096877.007549:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790096877.007572:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096877.007612:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324136960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096877.007623:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3317:1877052324136320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790096877.007723:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096877.007737:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324136704:0@lo:9:umount.0 00000100:00100000:2.0:1790096877.007792:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096877.007823:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324136832:0@lo:9:umount.0 00000100:00100000:2.0:1790096877.008033:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096877.008081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136704 00000100:00100000:2.0:1790096877.008089:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136704 00000100:00100000:2.0:1790096877.008132:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136832 00000100:00100000:2.0:1790096877.008136:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136832 00000100:00100000:2.0:1790096877.008247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790096877.008255:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877052324136704:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790096877.008289:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5769 00000100:00080000:2.0:1790096877.008300:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9eaaff2cf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790096877.008340:0:6695:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1790096877.008920:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3313:x1877052324136704:12345-0@lo:9:umount.0 Request processed in 663us (1125us total) trans 0 rc 0/0 00010000:00010000:3.0:1790096877.008924:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096877.008931:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790096877.008952:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790096877.008960:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3314:x1877052324136448:12345-0@lo:103:ldlm_bl.0 Request processed in 1637us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096877.008968:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790096877.009004:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324136576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096877.009036:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877052324136832:12345-0@lo:9:umount.0 00000100:00100000:3.0:1790096877.009039:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1790096877.009055:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5850 00000100:00080000:2.0:1790096877.009063:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9eaaeef5b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790096877.009091:0:6695:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1790096877.009174:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324136576 00000100:00100000:3.0:1790096877.009181:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324136576 00000100:00100000:3.0:1790096877.009292:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790096877.009300:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+15:3315:x1877052324136576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790096877.009309:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096877.009327:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17a200/0xcc97d9eae5ab5b28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b21 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096877.009339:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096877.009368:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3315:x1877052324136576:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096877.009454:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3313:x1877052324136832:12345-0@lo:9:umount.0 Request processed in 420us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096877.009461:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790096877.009485:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790096877.009513:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790096877.009545:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaad0ebb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790096877.009600:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:1.0:1790096877.009684:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096877.009886:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790096877.009925:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeeffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324136576:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1790096877.009925:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790096877.009936:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324136704:0@lo:9:umount.0 00000100:00080000:2.0:1790096877.009951:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790096877.009959:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3314:1877052324136448:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1790096877.010061:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790096877.010064:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790096877.010068:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324136832:0@lo:9:umount.0 00010000:00010000:2.0:1790096877.010093:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790096877.014042:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9eaac580b380) has no exports 00000020:00000080:0.0:1790096877.115081:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab562e 00000020:00000080:0.0:1790096877.115098:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaafbcbd000/lustre-QMT0000_UUID 00000020:01000000:0.0:1790096877.115124:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1790096877.115222:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790096877.115243:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790096877.115250:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9eaaef598000) has no exports 00000020:00000080:2.0:1790096877.115594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafbcbd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790096877.116479:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5627 00000020:00000080:1.0:1790096877.116503:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaad184f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790096877.116567:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaad184f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1790096877.116766:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790096877.116839:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790096877.116852:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790096877.116856:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaac37f6000/lustre-QMT0000_UUID 00000020:00000080:1.0:1790096877.116859:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac37f6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1790096877.116872:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1790096877.507165:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:2.0:1790096877.507174:0:7663:0:(genops.c:885:class_export_put()) final put ffff9eaac7fde000/7428525e-2b7d-490f-8a81-8b717b826fb3 00000001:00100000:2.0:1790096877.507205:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790096877.507208:0:7663:0:(genops.c:885:class_export_put()) final put ffff9eaaeef58000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790096877.507255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac7fde000/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-OST0001 00000020:00000080:0.0:1790096877.507308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaeef58000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790096877.507344:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaac7fde800 for lustre-OST0001 00000020:00000080:0.0:1790096877.507349:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaeef5b000 for lustre-OST0001 00000001:00100000:1.0:1790096878.013928:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 56fd0760-a5ee-4811-af5a-739a392b530e 00000001:00080000:1.0:1790096878.013946:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790096878.013952:0:5874:0:(genops.c:885:class_export_put()) final put ffff9eaac3097800/56fd0760-a5ee-4811-af5a-739a392b530e 00000001:00100000:1.0:1790096878.013970:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7428525e-2b7d-490f-8a81-8b717b826fb3 00000001:00080000:1.0:1790096878.013975:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1790096878.013988:0:5874:0:(genops.c:885:class_export_put()) final put ffff9eaaff214000/7428525e-2b7d-490f-8a81-8b717b826fb3 00000020:00000080:2.0:1790096878.014083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac3097800/56fd0760-a5ee-4811-af5a-739a392b530e for lustre-MDT0000 00000020:00000080:2.0:1790096878.014137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff214000/7428525e-2b7d-490f-8a81-8b717b826fb3 for lustre-MDT0000 00000020:00000080:2.0:1790096878.014171:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff321800 for lustre-MDT0000 00000020:00000080:2.0:1790096878.014177:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff216800 for lustre-MDT0000 00010000:00010000:2.0:1790096878.140803:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096878.461049:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790096878.461138:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324137216:0@lo:400:kworker.0 00000100:00100000:0.0:1790096878.461220:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096878.461283:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096878.461289:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324137344:0@lo:400:kworker.0 00000100:00100000:0.0:1790096878.461312:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096878.461342:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137216 00000100:00100000:0.0:1790096878.461350:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137216 00000100:00100000:0.0:1790096878.461397:0:8484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137344 00000100:00100000:0.0:1790096878.461400:0:8484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137344 00000100:00100000:0.0:1790096878.461417:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790096878.461424:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1877052324137216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790096878.461431:0:8484:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790096878.461468:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1877052324137216:12345-0@lo:400:kworker.0 Request processed in 43us (248us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790096878.461475:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790096878.461501:0:8484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790096878.461505:0:8484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1877052324137344:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790096878.461509:0:8484:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790096878.461529:0:8484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1877052324137344:12345-0@lo:400:kworker.0 Request processed in 23us (216us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790096878.461535:0:8484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1790096878.461566:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790096878.461570:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790096878.461574:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790096878.476230:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137088:0@lo:400:kworker.0 00000100:00100000:3.0:1790096878.476314:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096878.478366:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137088 00000100:00100000:1.0:1790096878.478381:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137088 00000100:00100000:1.0:1790096878.478442:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1790096878.478452:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3316:x1877052324137088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096878.478559:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5702850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85+14:3316:x1877052324137088:12345-0@lo:400:kworker.0 Request processed in 108us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096878.478567:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1790096878.478732:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137088:0@lo:400:kworker.0 00000100:00080000:0.0:1790096878.499782:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790096878.499811:0:3314:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 225 00000100:00080000:0.0:1790096878.499828:0:3314:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eaad0eb9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790096878.499950:0:3314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaafb3ebb80 x1877052324137472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790096878.499984:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1877052324137344:0@lo:400:kworker.0 00000100:00080000:0.0:1790096878.500073:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790096878.500077:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790096878.500081:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790096878.500084:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790096878.500087:0:3314:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 205 00000100:00080000:0.0:1790096878.500093:0:3314:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eaaff5d3000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790096878.500107:0:3314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaafb3e8380 x1877052324137600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790096878.500117:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324137216:0@lo:400:kworker.0 00000100:00100000:3.0:1790096878.503287:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324137472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790096878.503360:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096878.503392:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324137600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790096878.503416:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096878.503453:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137472 00000100:00100000:3.0:1790096878.503461:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137472 00000100:00100000:3.0:1790096878.503502:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137600 00000100:00100000:3.0:1790096878.503506:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137600 00000100:00100000:3.0:1790096878.503527:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790096878.503534:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1877052324137472:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1790096878.503551:0:5852:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790096878.504282:0:7513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790096878.504289:0:7513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1877052324137600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1790096878.504299:0:7513:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790096878.504357:0:7513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1877052324137600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (939us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790096878.504365:0:7513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1790096878.504416:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790096878.504422:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790096878.504425:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324137600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790096878.519951:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1877052324137472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16410us (16584us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790096878.519965:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1790096878.520022:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790096878.520028:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790096878.520033:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324137472:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1790096878.552498:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790096878.552508:0:6721:0:(genops.c:885:class_export_put()) final put ffff9eaaff2ce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790096878.552614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff2ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790096878.552697:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff2cf000 for lustre-OST0000 00010000:00010000:1.0:1790096879.164924:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790096879.165001:0:13036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaaeb63dde0 - data ffff9eaaff9c9510/ffff9eaac4ee3400 00000020:01000000:0.0:1790096879.165137:0:13036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaaee9e2660 - data ffff9eaad1419ca8/ffff9eaac5cae800 00000001:00000004:0.0:1790096879.174940:0:13036:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1790096879.339815:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790096879.339825:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790096879.339845:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790096879.339848:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790096879.340133:0:6999:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790096879.340139:0:6999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790096879.340150:0:6999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790096879.341337:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790096879.341342:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790096879.341392:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790096879.341395:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790096879.341953:0:8072:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790096879.341959:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790096879.341968:0:8072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1790096879.448501:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab55f6 00000020:00000080:2.0:1790096879.448523:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaed5dd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790096879.448626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaed5dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790096879.451926:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab560b 00000020:00000080:2.0:1790096879.451940:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaafbcb8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790096879.458580:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790096879.458704:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafbcb8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1790096879.461944:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.461959:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790096879.461964:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9eaac58099c0) has no exports 00000004:01000000:0.0:1790096879.462152:0:13036:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790096879.462162:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5849 00000020:00000080:0.0:1790096879.462171:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaeef5b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790096879.462191:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790096879.462195:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.462201:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790096879.462203:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9eaac97d0000) has no exports 00000020:00000080:0.0:1790096879.462209:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5842 00000020:00000080:0.0:1790096879.462212:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaee997000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790096879.462568:0:13036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790096879.462572:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790096879.462576:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790096879.462581:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790096879.462584:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790096879.462628:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.462657:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790096879.462664:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5762 00000020:00000080:0.0:1790096879.462668:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaff746000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790096879.462672:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790096879.462675:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.462679:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790096879.462681:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9eaad18619c0) has no exports 00000020:00000080:0.0:1790096879.462685:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab575b 00000020:00000080:0.0:1790096879.462687:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaad0eb8000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790096879.463075:0:13036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790096879.463080:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790096879.463082:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1790096879.463085:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790096879.463087:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790096879.463112:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.463118:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790096879.463159:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.463164:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790096879.463168:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaed5dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790096879.463171:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaed5dc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790096879.463177:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790096879.463334:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5612 00000020:00000080:0.0:1790096879.463339:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaafbcbe000/lustre-MDD0000_UUID 00000020:01000000:0.0:1790096879.463344:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790096879.463347:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.463350:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790096879.463352:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9eaafbcb3380) has no exports 00000020:00000080:0.0:1790096879.463375:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.463378:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790096879.463381:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5619 00000020:00000080:0.0:1790096879.463384:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaafbcba800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790096879.463399:0:13036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaac41f3800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790096879.463402:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac41f3800 3 00000020:01000004:0.0:1790096879.463405:0:13036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eaac41f3800 from lustre-MDT0000 00000020:00000080:0.0:1790096879.463424:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.463428:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790096879.463431:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaed5d8800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790096879.463433:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaed5d8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790096879.463439:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790096879.463464:0:13036:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790096879.463467:0:13036:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790096879.463470:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790096879.463473:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.463486:0:13036:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790096879.463493:0:13036:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9eaae6095800 f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096879.463498:0:13036:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9eaac580cd40) has exports, disconnecting them 00000020:00080000:0.0:1790096879.463502:0:13036:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9eaae6095800), last request at 1790096656 00000020:00000080:0.0:1790096879.463516:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab55b7 00000020:00010000:0.0:1790096879.463520:0:13036:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9eaae6095800: total 6 00000100:00080000:0.0:1790096879.463524:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9eaae6094000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790096879.463543:0:13036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaae6095800): rc 0 00000020:00080000:0.0:1790096879.463548:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9eaac580cd40) has no exports 00000100:00100000:0.0:1790096879.463608:0:5844:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9eaad57ce600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1790096879.463968:0:5845:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9eaad57cec00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1790096879.464255:0:5846:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9eaad57cfc00:5846] 2 exiting: rc = 0 00000020:00000080:1.0:1790096879.464307:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaeef5b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790096879.464316:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaee997000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790096879.464331:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff5d4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790096879.464339:0:37:0:(genops.c:885:class_export_put()) final put ffff9eaaeef5d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790096879.464342:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaeef5d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790096879.464349:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790096879.464419:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff746000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790096879.464424:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaad0eb8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1790096879.464433:0:7650:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9eaae6095800: total 2 00000020:00000080:1.0:1790096879.464440:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaad0ebb000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790096879.464445:0:37:0:(genops.c:885:class_export_put()) final put ffff9eaaff324000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790096879.464447:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff324000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790096879.464450:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:00010000:2.0:1790096879.464466:0:7650:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eaae6095800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1790096879.464502:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db8c00/0xcc97d9eae5ab5b0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b05 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464517:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab58f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ea expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790096879.464524:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafbcbe000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:2.0:1790096879.464528:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab56cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab56c8 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790096879.464528:0:37:0:(genops.c:885:class_export_put()) final put ffff9eaaed5dc000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790096879.464530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaed5dc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790096879.464538:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:2.0:1790096879.464541:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1539400/0xcc97d9eae5ab591b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5914 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464551:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690e00/0xcc97d9eae5ab5b1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab5b13 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464562:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8691c00/0xcc97d9eae5ab58c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab58c0 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464571:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac1538000/0xcc97d9eae5ab58e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab58dc expref: 3 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464581:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaafb17a600/0xcc97d9eae5ab58d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc97d9eae5ab58ce expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096879.464589:0:7650:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eaae6095800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1790096879.464600:0:7650:0:(genops.c:885:class_export_put()) final put ffff9eaae6095800/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 00010000:00010000:2.0:1790096879.464616:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096879.464618:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096879.464619:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790096879.465067:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafbcba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790096879.465076:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaae6095800/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 for MGS 00000020:00000080:2.0:1790096879.465109:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaae6094000 for MGS 00000100:00100000:0.0:1790096879.465951:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.465961:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.465971:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.465981:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.465989:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.465995:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466417:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466425:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466513:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466520:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466539:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466548:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466556:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466565:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466570:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466576:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466581:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466587:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466593:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466599:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466607:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466613:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466618:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466624:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.466629:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467155:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467163:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467168:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467173:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467178:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467183:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467188:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467194:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467200:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467207:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467214:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467221:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467229:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467236:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467243:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467250:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467257:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467264:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467271:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467277:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467293:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467299:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467306:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467313:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467320:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467327:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467334:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467340:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467346:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467351:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467357:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467362:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467368:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467373:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467379:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467384:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467389:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467395:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096879.467400:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1790096879.469098:0:13036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790096879.469105:0:13036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790096879.479934:0:13036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaac9703840 - data ffff9eaae9683510/ffff9eaaff6e6400 00000020:01000000:0.0:1790096879.480626:0:13036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaaeb793600 - data ffff9eaae944d948/ffff9eaad574e000 00000020:00000080:0.0:1790096879.481969:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab559b 00000020:00000080:0.0:1790096879.481979:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaac9b12800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790096879.481992:0:13036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaac41f3800 from MGS, refs=2 00000020:01000004:0.0:1790096879.481995:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac41f3800 2 00000020:00000080:1.0:1790096879.482120:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac9b12800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1790096879.482160:0:13036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eaac41f3800 from MGS 00000020:00000080:0.0:1790096879.482188:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096879.482196:0:13036:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790096879.482200:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaac41f4800/MGS 00000020:00000080:0.0:1790096879.482203:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac41f4800/MGS for MGS 00000020:01000000:0.0:1790096879.482210:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790096879.482269:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790096879.482274:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096879.482280:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790096879.482297:0:13036:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9eaaed5d9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096879.482303:0:13036:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9eaafbcb0000) has exports, disconnecting them 00000020:00080000:0.0:1790096879.482308:0:13036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9eaaed5d9800), last request at 1790096658 00000020:00000080:0.0:1790096879.482313:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5666 00000020:00080000:0.0:1790096879.482325:0:13036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaaed5d9800): rc 0 00000020:00000080:0.0:1790096879.482328:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaaed5d9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790096879.482373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaed5d9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790096879.494803:0:13036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790096879.494813:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790096879.494817:0:13036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790096879.494825:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790096879.494892:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaef5ad800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790096879.495079:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790096879.495089:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790096879.495094:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaafbcbc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790096879.495098:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaafbcbc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790096879.495111:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790096879.495177:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac41f3800 1 00000020:00000080:1.0:1790096879.495183:0:13036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab558d 00000020:00000080:1.0:1790096879.495206:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaac41f0000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790096879.495222:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790096879.495227:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790096879.495232:0:13036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790096879.495236:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9eaac5808000) has no exports 00000020:00000080:2.0:1790096879.495247:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac41f0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790096879.525685:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790096879.525701:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790096879.525707:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaac41f6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790096879.525721:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac41f6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790096879.525732:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790096879.525909:0:13036:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eaac41f7800 00000020:01000000:1.0:1790096879.525933:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790096879.525937:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790096879.525942:0:13036:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790096879.525946:0:13036:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9eaad1860000) has no exports 00000100:00100000:3.0:1790096879.526030:0:5852:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9eaac591d800:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1790096879.526734:0:7513:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9eaac797e000:7513] 3 exiting: rc = 0 00000100:00100000:0.0:1790096879.527803:0:8484:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9eaafb212e00:8484] 4 exiting: rc = 0 00000100:00100000:2.0:1790096879.535927:0:5851:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9eaad5674600:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1790096879.536024:0:5853:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9eaac591d000:5853] 2 exiting: rc = 0 00000100:00100000:1.0:1790096879.537137:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537144:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537151:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537157:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537162:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537168:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537173:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537179:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537184:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537190:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537195:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537200:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537205:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537211:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537216:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537221:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537226:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537231:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537250:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537264:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537270:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537276:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537281:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537287:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537292:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537297:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537303:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537307:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537312:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537318:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537323:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537328:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537334:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537339:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537345:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537350:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537355:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537360:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537365:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537370:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537375:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537381:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537386:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537391:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537396:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537400:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537405:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537410:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537418:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537423:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537440:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537446:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537451:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537464:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537469:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537485:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537492:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537497:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537503:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537508:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537514:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537520:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537526:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.537539:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.546748:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9eaac591c000:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1790096879.549177:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9eaac591de00:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1790096879.549271:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549281:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549288:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549293:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549299:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549305:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549311:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549316:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549322:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549327:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549333:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549339:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549358:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549366:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549373:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549380:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549386:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549394:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549403:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549411:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549432:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549439:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549447:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549453:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549459:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549488:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549498:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549506:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549514:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549537:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549548:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549554:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549558:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549571:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549576:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549581:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549587:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549599:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549605:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549611:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549616:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549621:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549628:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549651:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549657:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549662:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549668:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549673:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549678:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549683:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549689:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549694:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549702:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549709:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549715:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549730:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549735:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549740:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549745:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549750:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549755:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549760:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549765:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.549771:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550185:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9eaad1834e00:5856] 0 exiting: rc = 1 00000100:00100000:1.0:1790096879.550417:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9eaac869fc00:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1790096879.550773:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550782:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550789:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550796:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550803:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550808:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550815:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550821:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550827:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550832:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550838:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550845:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550851:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550856:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550861:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550882:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550890:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550896:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550902:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550908:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550914:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550920:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550926:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550932:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550938:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550954:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550959:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550979:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550986:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550991:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.550997:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551003:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551009:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551015:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551021:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551027:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551033:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551039:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551046:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551066:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551074:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551080:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551085:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551091:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551098:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551104:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551110:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551116:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551122:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551127:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551133:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551152:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551159:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551165:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551171:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551176:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551182:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551188:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551194:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551200:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551213:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551219:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551224:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.551231:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.568125:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9eaac869f800:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1790096879.571208:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9eaac869f000:5859] 1 exiting: rc = 0 00000100:00100000:2.0:1790096879.571317:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571325:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571331:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571337:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571343:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571350:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571355:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571360:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571365:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571370:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571375:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571380:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571385:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571390:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571395:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571400:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571405:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571410:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571415:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571419:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571424:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571429:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571435:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571440:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571444:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571449:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571455:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571460:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571484:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571491:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571511:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571515:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571520:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571525:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571530:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571535:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571541:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571547:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571553:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571558:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571564:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571569:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571573:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571578:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571583:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.571588:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572937:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572944:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572950:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572957:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572962:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572967:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572972:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572978:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572983:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572988:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572993:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.572998:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573003:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573009:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573014:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573019:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573024:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.573029:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.573570:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9eaac869e000:5861] 1 exiting: rc = 0 00000100:00100000:2.0:1790096879.577190:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9eaac869fe00:5860] 0 exiting: rc = 1 00000100:00100000:1.0:1790096879.577544:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577552:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577557:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577562:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577566:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577571:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577576:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577582:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577586:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577593:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577598:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577603:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577608:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577613:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577618:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577623:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577628:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577648:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577655:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577660:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577666:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577681:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577687:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577693:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577698:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577705:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577710:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577715:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577721:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577725:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577731:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577736:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577740:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577745:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577750:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577755:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577760:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577764:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577769:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577781:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577787:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577793:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577798:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577804:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577809:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577814:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577820:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577826:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577831:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577837:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577842:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577848:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577853:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577858:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577863:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577868:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577883:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577888:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577893:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577898:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577903:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577909:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577913:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.577919:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790096879.578343:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9eaac869ee00:5862] 0 exiting: rc = 1 00000100:00100000:3.0:1790096879.579441:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9eaac869f600:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1790096879.579552:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579560:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579565:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579571:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579576:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579581:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579587:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579593:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579599:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579605:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579609:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579614:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579619:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579625:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579630:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579655:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579661:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579667:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579672:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579678:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579683:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579688:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579694:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579699:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579704:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579709:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579714:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579736:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579741:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579746:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579752:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579757:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579763:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579769:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579774:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579779:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579785:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579790:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579795:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579801:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579806:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579811:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579817:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579823:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579827:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579833:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579837:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579842:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579847:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579853:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579858:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579864:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579869:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579874:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579879:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579883:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579888:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579893:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579897:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579902:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579907:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579912:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579926:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.579931:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.580470:0:5865:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9eaac96a6a00:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1790096879.580733:0:5866:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9eaad0ec4200:5866] 2 exiting: rc = 0 00000100:00100000:2.0:1790096879.580926:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9eaac869f200:5864] 0 exiting: rc = 1 00000100:00100000:1.0:1790096879.585084:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585094:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585100:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585105:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585110:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585116:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585122:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585128:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585134:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585139:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585170:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585178:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585183:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585189:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585194:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585200:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585205:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585213:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585218:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585224:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585229:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585233:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585239:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585244:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585250:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585255:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585261:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585266:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585271:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585277:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585281:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585301:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585307:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585313:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585332:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585338:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585345:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585350:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585356:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585361:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585367:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585372:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585378:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585383:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585388:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585394:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585399:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585405:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585411:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585417:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585424:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585564:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585574:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585580:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585585:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585591:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585596:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585603:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585609:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585614:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585620:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585625:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585632:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096879.585659:0:13036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790096879.601590:0:13036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790096879.601604:0:13036:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790096879.601621:0:13036:0:(genops.c:885:class_export_put()) final put ffff9eaad1849000/MDS_uuid 00000020:00000080:1.0:1790096879.601626:0:13036:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaad1849000/MDS_uuid for MDS 00000020:01000000:1.0:1790096879.601650:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790096879.601808:0:13036:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790096880.189793:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096881.213908:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096882.255474:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790096883.052126:0:13189:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790096883.075562:0:13189:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790096883.075622:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.077555:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.077568:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.077574:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.077599:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790096883.077604:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790096883.077632:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790096883.077656:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790096883.077661:0:13189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790096883.077667:0:13189:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790096883.077672:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790096883.077673:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790096883.077676:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790096883.078536:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078549:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078571:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078576:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078598:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790096883.078605:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078611:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078617:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078623:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078665:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1790096883.078669:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790096883.078688:0:13189:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790096883.078693:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790096883.078707:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790096883.078712:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078720:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17ae00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096883.078723:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078738:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096883.078745:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096883.078750:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790096883.078752:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790096883.078754:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790096883.078788:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078794:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096883.078814:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078822:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17ae00/0xcc97d9eae5ab58dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58e3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078835:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096883.078838:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096883.078847:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078854:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096883.078871:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096883.078876:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790096883.078879:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790096883.078880:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790096883.078894:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078900:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096883.078907:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078912:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b200/0xcc97d9eae5ab58ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab58f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078921:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096883.078923:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078929:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaafb17b800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096883.078931:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078938:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096883.078943:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096883.078958:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790096883.078960:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790096883.078962:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790096883.078974:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.078979:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790096883.078993:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.079000:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17b800/0xcc97d9eae5ab5b13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc97d9eae5ab5b1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096883.079008:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096883.079010:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096883.079012:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096883.079029:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096883.079092:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096883.079140:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096883.079146:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096883.079167:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096883.079191:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096883.079198:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324137984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790096883.079220:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1790096883.079241:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790096883.079249:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790096883.079254:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9eaad1864d40) has no exports 00000020:00080000:2.0:1790096883.079277:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9eaad1864d40) has no exports 00010000:00010000:1.0:1790096883.080532:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096883.080709:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096883.080729:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137728 00000100:00100000:3.0:1790096883.080739:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137728 00000100:00100000:3.0:1790096883.080783:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137856 00000100:00100000:3.0:1790096883.080787:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137856 00000100:00100000:3.0:1790096883.080799:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324137984 00000100:00100000:3.0:1790096883.080801:0:11191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324137984 00000100:00100000:3.0:1790096883.080815:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790096883.080823:0:11191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3316:x1877052324137728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790096883.080830:0:11191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790096883 with bad export cookie 14742491508119393719 00000020:01000000:2.0:1790096883.087037:0:13189:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaac3123600 - data ffff9eaaf837e1b0/ffff9eaaeef48000 00000020:01000000:2.0:1790096883.087195:0:13189:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaac4c6c660 - data ffff9eaae978d360/ffff9eaac96a2c00 00000100:00100000:3.0:1790096883.095830:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790096883.095852:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1877052324137856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790096883.095861:0:8472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790096883 with bad export cookie 14742491508119393719 00000100:00100000:3.0:1790096883.095963:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1877052324137856:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (16794us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790096883.095971:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790096883.096001:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790096883.096006:0:8472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1877052324137984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790096883.096011:0:8472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790096883 with bad export cookie 14742491508119393719 00000100:00100000:3.0:1790096883.096056:0:8472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1877052324137984:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (16834us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790096883.096061:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790096883.096135:0:11191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3316:x1877052324137728:12345-0@lo:103:ldlm_bl.0 Request processed in 15312us (17042us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790096883.096141:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790096883.096232:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790096883.096238:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9eaae6095000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790096883.096241:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790096883.099722:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790096883.105591:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790096883.105598:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790096883.105612:0:3315:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaad57e5180 x1877052324137728/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790096899 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096883.105627:0:3315:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaad57e7480 x1877052324137856/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790096899 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096883.105766:0:3315:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaad57e6680 x1877052324137984/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790096899 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790096883.105776:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790096883.105779:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790096883.105780:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790096883.105868:0:3316:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9eaae6095000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790096883.105898:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096883.105928:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3316:1877052324137856:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1790096883.105981:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9eaae6095000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790096883.105987:0:3315:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 186 00000100:00080000:1.0:1790096883.106004:0:3315:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff9eaae6095000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096883.106042:0:3315:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaffe9bb80 x1877052324138112/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096883.106105:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3313:1877052324138112:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1790096883.106156:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877052324138112 offset 0 length 520: 4 00000100:00100000:1.0:1790096883.106224:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3315:1877052324137984:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1790096883.121016:0:13189:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790096883.171966:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab56eb 00000020:00000080:0.0:1790096883.172044:0:13189:0:(genops.c:885:class_export_put()) final put ffff9eaaff320800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790096883.172093:0:13189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaac4279800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790096883.172097:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac4279800 2 00000020:01000004:0.0:1790096883.172100:0:13189:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eaac4279800 from lustre-OST0000 00000020:00000080:0.0:1790096883.172127:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096883.172136:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790096883.172139:0:13189:0:(genops.c:885:class_export_put()) final put ffff9eaaee7c3800/lustre-OST0000_UUID 00000020:00000080:0.0:1790096883.172142:0:13189:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaee7c3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790096883.172149:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790096883.172191:0:13189:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790096883.172195:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790096883.172199:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096883.172204:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790096883.172211:0:13189:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9eaaff5d2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790096883.172217:0:13189:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9eaaef5999c0) has exports, disconnecting them 00000020:00080000:0.0:1790096883.172308:0:13189:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9eaaff5d2800), last request at 1790096675 00000020:00000080:0.0:1790096883.172333:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5715 00000020:00080000:0.0:1790096883.172345:0:13189:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaaff5d2800): rc 0 00000020:00000080:0.0:1790096883.172350:0:13189:0:(genops.c:885:class_export_put()) final put ffff9eaaff5d2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790096883.175069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff320800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790096883.177018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff5d2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790096883.177698:0:13189:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790096883.177703:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790096883.177708:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790096883.177714:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790096883.177887:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790096883.177895:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1790096883.177902:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac4279800 1 00000020:00000080:1.0:1790096883.177908:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab56a5 00000020:00000080:1.0:1790096883.177917:0:13189:0:(genops.c:885:class_export_put()) final put ffff9eaac9660800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790096883.177923:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790096883.177928:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790096883.177934:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790096883.177937:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9eaaef59cd40) has no exports 00000020:00000080:2.0:1790096883.178157:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaaff5d3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790096883.178166:0:37:0:(genops.c:885:class_export_put()) final put ffff9eaaff2b1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790096883.178169:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff2b1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790096883.178181:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790096883.178240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac9660800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790096883.203220:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790096883.203237:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790096883.203244:0:13189:0:(genops.c:885:class_export_put()) final put ffff9eaac427c000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790096883.203249:0:13189:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac427c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790096883.203616:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790096883.204562:0:13189:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eaac427d000 00000020:02000400:2.0:1790096883.204616:0:13189:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1790096883.268997:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790096883.584747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3fc9c4a-28d1-48dc-adb2-3db9678ceb85->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790096883.584759:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3fc9c4a-28d1-48dc-adb2-3db9678ceb85->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790096883.584762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790096883.584766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790096883.584770:0:8:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790096883.584780:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1790096883.584786:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790096883.584801:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eaad0eb9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096883.584847:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaffe9b480 x1877052324138240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096883.584956:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324138240:0@lo:38:kworker.0 00000400:00000100:3.0:1790096883.585008:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877052324138240 offset 0 length 520: 4 00010000:00010000:2.0:1790096884.284811:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096885.315369:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790096886.169526:0:13339:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790096886.198612:0:13339:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790096886.198744:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096886.198767:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096886.198775:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096886.198791:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096886.198812:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790096886.198817:0:13339:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790096886.198844:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790096886.198857:0:13339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaaffe9b480 x1877052324138240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790096898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096886.198872:0:13339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790096886.198879:0:13339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790096886.198886:0:13339:0:(import.c:65:import_set_state_nolock()) ffff9eaad0eb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790096886.198892:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790096886.198895:0:13339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaaffe9b480 x1877052324138240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790096898 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096886.198903:0:13339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790096886.198906:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:3.0:1790096886.199741:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096886.199753:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096886.199764:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096886.199769:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096886.199779:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096886.199787:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096886.199794:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790096886.199797:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790096886.199799:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790096886.199817:0:7650:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eaae6095000 00010000:00010000:3.0:1790096886.199821:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096886.199829:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1539200/0xcc97d9eae5ab58c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab58c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096886.199857:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096886.199859:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096886.199861:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096886.199894:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324138240:0@lo:38:kworker.0 00010000:00010000:2.0:1790096886.201413:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201445:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201454:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201462:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201545:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790096886.201553:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201575:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201582:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201588:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201610:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790096886.201614:0:13339:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790096886.201667:0:13339:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790096886.201673:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1790096886.201691:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096886.201698:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201706:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac1539e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096886.201710:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201719:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096886.201725:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096886.201731:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790096886.201733:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790096886.201742:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790096886.201758:0:5840:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eaae6095000 00010000:00010000:2.0:1790096886.201761:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201768:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac1539e00/0xcc97d9eae5ab58ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab58d5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201783:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096886.201786:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201792:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:2.0:1790096886.201795:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201801:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790096886.201807:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096886.201812:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790096886.201814:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790096886.201816:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790096886.201820:0:5840:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eaae6095000 00010000:00010000:2.0:1790096886.201822:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201828:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab5b05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab5b0c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096886.201850:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096886.201852:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096886.201853:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790096886.201865:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790096886.201874:0:13339:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790096886.201880:0:13339:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9eaad1863380) has no exports 00000020:00080000:2.0:1790096886.201912:0:13339:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9eaad1863380) has no exports 00010000:00010000:3.0:1790096886.202959:0:7651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790096886.204025:0:13339:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaac3123180 - data ffff9eaaf8220360/ffff9eaaeef4ac00 00000020:01000000:2.0:1790096886.204214:0:13339:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eaac42a2a80 - data ffff9eaae9427bd0/ffff9eaaeef9b800 00100000:10000000:2.0:1790096886.219949:0:13339:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790096886.257378:0:13339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab57b6 00000020:00000080:0.0:1790096886.257392:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaaff07e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790096886.257412:0:13339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaaff322800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790096886.257416:0:13339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaaff322800 2 00000020:01000004:0.0:1790096886.257420:0:13339:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eaaff322800 from lustre-OST0001 00000020:00000080:1.0:1790096886.257440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff07e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790096886.257463:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096886.257474:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790096886.257478:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaaff07e800/lustre-OST0001_UUID 00000020:00000080:0.0:1790096886.257480:0:13339:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff07e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790096886.257487:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790096886.257688:0:13339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f3fc9c4a-28d1-48dc-adb2-3db9678ceb85->MGS 00010000:00010000:0.0:1790096886.257710:0:13339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096886.257724:0:13339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096886.257735:0:13339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790096886.257739:0:13339:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790096886.257743:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790096886.257763:0:13339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eaae6095000 00010000:00010000:0.0:1790096886.257779:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab56c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab56cf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096886.257798:0:13339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096886.257805:0:13339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096886.257810:0:13339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790096886.257812:0:13339:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790096886.257825:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790096886.257836:0:13339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eaae6095000 00010000:00010000:0.0:1790096886.257839:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaafb17bc00/0xcc97d9eae5ab5914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc97d9eae5ab591b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790096886.257856:0:13339:0:(import.c:65:import_set_state_nolock()) ffff9eaae6095000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790096886.257860:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790096886.257862:0:13339:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790096886.257864:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790096886.257869:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790096886.257883:0:13339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eaaffe9bb80 x1877052324138112/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790096893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790096886.257895:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790096886.257898:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1790096886.258166:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3fc9c4a-28d1-48dc-adb2-3db9678ceb85:3313:1877052324138112:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:0.0:1790096886.258569:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790096886.258584:0:13339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab55a9 00000020:00000080:0.0:1790096886.258592:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaad184b000/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 00000020:01000000:0.0:1790096886.258610:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.111@tcp (flags='') 00000020:00000080:0.0:1790096886.258616:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096886.258623:0:13339:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790096886.258628:0:13339:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9eaac97d4d40) has no exports 10000000:01000000:3.0:1790096886.258696:0:5849:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790096886.258725:0:13339:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.111@tcp: client import never connected 00000100:00080000:0.0:1790096886.258728:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790096886.258730:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790096886.258733:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790096886.258735:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790096886.258775:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790096886.258781:0:13339:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.111@tcp (uuid f3fc9c4a-28d1-48dc-adb2-3db9678ceb85) 00000020:01000000:0.0:1790096886.258786:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790096886.258789:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790096886.258792:0:13339:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790096886.258797:0:13339:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9eaad0ebd000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1790096886.258799:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaad184b000/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 for MGC192.168.203.111@tcp 00000020:00000080:1.0:1790096886.258808:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaae6095000 for MGC192.168.203.111@tcp 00000020:00080000:0.0:1790096886.258813:0:13339:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9eaaef59b380) has exports, disconnecting them 00000020:00080000:0.0:1790096886.258818:0:13339:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9eaad0ebd000), last request at 1790096695 00000020:00000080:1.0:1790096886.258819:0:37:0:(genops.c:885:class_export_put()) final put ffff9eaae6092800/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 00000020:00000080:1.0:1790096886.258821:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaae6092800/f3fc9c4a-28d1-48dc-adb2-3db9678ceb85 for MGC192.168.203.111@tcp 00000020:00000080:0.0:1790096886.258822:0:13339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab57e0 00000020:01000000:1.0:1790096886.258825:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.111@tcp (f3fc9c4a-28d1-48dc-adb2-3db9678ceb85) 00000020:00080000:0.0:1790096886.258833:0:13339:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eaad0ebd000): rc 0 00000020:00000080:0.0:1790096886.258838:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaad0ebd000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790096886.259144:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaad0ebd000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790096886.266763:0:13339:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790096886.266777:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790096886.266783:0:13339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790096886.266794:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790096886.266915:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9eaad0eb9800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1790096886.268762:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790096886.269800:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790096886.269971:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1790096886.270104:0:7651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1790096886.270460:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9eaad57c3800:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1790096886.271800:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9eaad57c3000:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1790096886.273533:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.273928:0:5838:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9eaad57c3200:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1790096886.274047:0:5836:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9eaad5618a00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1790096886.274108:0:5837:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9eaad57c2a00:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1790096886.274174:0:11191:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9eaafb831800:11191] 4 exiting: rc = 0 00000100:00100000:0.0:1790096886.274350:0:8472:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9eaaffc6e600:8472] 3 exiting: rc = 0 00000100:00100000:3.0:1790096886.274693:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274700:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274708:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274715:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274722:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274731:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274738:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274744:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274749:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274755:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274760:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274766:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274779:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274787:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274794:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274801:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274829:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274834:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274840:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274846:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274851:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274857:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274863:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274869:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274875:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274881:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274886:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274891:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274896:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274901:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274907:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274913:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274918:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274923:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274928:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274934:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274940:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274946:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274952:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274958:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274964:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274969:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274975:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274981:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274986:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274992:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.274997:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275003:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275008:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275014:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275019:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275036:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275042:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275047:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275052:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275058:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275064:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275070:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275075:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275080:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275086:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275092:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275098:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.275106:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790096886.276873:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790096886.276887:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790096886.276895:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaaee996800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790096886.276900:0:13339:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaee996800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790096886.276907:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790096886.276959:0:13339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaaff322800 1 00000020:00000080:3.0:1790096886.276967:0:13339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcc97d9eae5ab5785 00000020:00000080:3.0:1790096886.276974:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaaff213000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790096886.276994:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790096886.277000:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790096886.277004:0:13339:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790096886.277009:0:13339:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9eaac97d3380) has no exports 00000020:00000080:0.0:1790096886.277126:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff213000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790096886.320453:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790096886.320480:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790096886.320488:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaaff321000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790096886.320495:0:13339:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaaff321000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790096886.320512:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790096886.320835:0:13339:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eaaff322000 00000020:01000000:3.0:1790096886.320869:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790096886.320875:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790096886.321022:0:13339:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790096886.321028:0:13339:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9eaac97d19c0) has no exports 00000020:00000080:3.0:1790096886.321103:0:13339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790096886.321112:0:13339:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790096886.321116:0:13339:0:(genops.c:885:class_export_put()) final put ffff9eaac9665800/OSS_uuid 00000020:00000080:3.0:1790096886.321119:0:13339:0:(genops.c:844:class_export_destroy()) destroying export ffff9eaac9665800/OSS_uuid for OSS 00000020:01000000:3.0:1790096886.321128:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1790096886.321334:0:5847:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790096886.321583:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9eaad0ec5000:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1790096886.321820:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9eaad0ec4400:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1790096886.321864:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9eaad0ec5800:6696] 2 exiting: rc = 0 00000100:00100000:3.0:1790096886.322474:0:7012:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9eaaf40d6800:7012] 3 exiting: rc = 0 00000100:00100000:3.0:1790096886.322559:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322568:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322584:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322592:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322598:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322604:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322610:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322616:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322622:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322628:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322661:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322669:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322676:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322682:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322691:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322697:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322702:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322708:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322714:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322720:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322725:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322769:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322775:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322781:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322787:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322793:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322799:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322954:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322963:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322970:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322977:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322983:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322989:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.322995:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323001:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323006:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323012:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323018:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323191:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323197:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323204:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323210:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323215:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323221:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323226:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323231:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323237:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323243:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323249:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323255:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323261:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323267:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323566:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323572:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323578:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323611:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323620:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323625:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323631:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323666:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323674:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323680:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323695:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.323701:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.366157:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9eaaf3bf3400:6699] 1 exiting: rc = 0 00000100:00100000:1.0:1790096886.366288:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9eaad0ec5400:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1790096886.367518:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367532:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367538:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367544:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367550:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367556:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367562:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367568:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367574:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367581:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367587:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367593:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367599:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367605:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367611:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367648:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367657:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367665:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367672:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367680:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367688:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367697:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367704:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367711:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367718:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367725:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367731:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367737:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367744:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367751:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367757:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367762:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367768:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367773:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367779:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367785:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367790:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367797:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367803:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367808:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367814:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367819:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367824:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367830:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367835:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367840:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367846:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367852:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367858:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367864:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367879:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367884:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367890:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367895:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367900:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367906:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367911:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367918:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367923:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367929:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367935:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367941:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367948:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.367963:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.371313:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9eaaf3bf2a00:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1790096886.371368:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9eaaeb667200:6702] 2 exiting: rc = 0 00000100:00100000:3.0:1790096886.372030:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9eaaf3bf3600:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1790096886.372204:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372217:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372225:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372231:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372238:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372245:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372255:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372264:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372275:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372283:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372291:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372378:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372391:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372398:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372442:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372465:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372473:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372480:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372486:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372494:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372502:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372508:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372515:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372522:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372529:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372535:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372542:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372568:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372575:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372583:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372591:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372598:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372604:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372610:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372617:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372625:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372654:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372666:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372674:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372697:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372711:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372719:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372725:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372731:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372739:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372745:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372752:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372760:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372767:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372773:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372779:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372785:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372792:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372798:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372804:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372811:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372817:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372825:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372832:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372847:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372855:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372860:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372873:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.372886:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.378705:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9eaaf3bf3200:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1790096886.380241:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9eaad572ee00:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1790096886.380373:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380383:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380396:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380500:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380509:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380514:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380520:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380526:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380532:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380538:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380545:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380550:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380557:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380562:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380569:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380574:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380579:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380585:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380591:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380620:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380626:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380631:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380658:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380663:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380670:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380677:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380684:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380691:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380699:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380707:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380715:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380720:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380724:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380728:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380733:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380738:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380744:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380750:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380756:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380762:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380767:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380772:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380778:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380784:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380790:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380795:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380802:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380807:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380812:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380818:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380823:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380828:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380833:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380838:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380851:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380857:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380862:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380869:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380874:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380880:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380886:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380891:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380897:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790096886.380904:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790096886.383453:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9eaac7e9f800:6705] 0 exiting: rc = 1 00000100:00100000:0.0:1790096886.383545:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9eaac2fb3800:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1790096886.383667:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383677:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383684:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383695:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383704:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383710:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383720:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383727:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383817:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383827:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383833:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383839:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383851:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383862:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383872:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383880:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383888:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383895:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383902:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383909:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383932:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383940:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383947:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383954:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383961:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383968:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383974:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383981:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.383987:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384009:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384017:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384025:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384047:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384055:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384061:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384068:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384078:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384084:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384091:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384099:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384169:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384242:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384254:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384261:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384284:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384293:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384302:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384311:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384321:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384328:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384335:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384341:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384352:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384359:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384368:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384380:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384409:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384418:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384435:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384442:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384451:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384458:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384466:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790096886.384473:0:13339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1790096886.392020:0:13339:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790096907.040725:0:13958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790096916.200582:0:14419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790096916.200587:0:14419:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790096916.200749:0:14419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea9c3140800 00000020:01000004:2.0:1790096916.200763:0:14419:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790096916.200770:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790096916.200785:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9eaafbcb4d40) 00000020:00000080:2.0:1790096916.200797:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790096916.221722:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790096916.223497:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790096916.223938:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790096916.224006:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 537: rc = 0 00100000:10000000:2.0:1790096916.224102:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 537: rc = 0 00100000:10000000:2.0:1790096916.224202:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 537: rc = 0 00100000:10000000:3.0:1790096916.234031:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 537: rc = 0 00100000:10000000:3.0:1790096916.234134:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 537: rc = 0 00100000:10000000:3.0:1790096916.234313:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 537: rc = 0 00100000:10000000:3.0:1790096916.234575:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 539: rc = 0 00100000:10000000:3.0:1790096916.235568:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 386: rc = 0 00100000:10000000:3.0:1790096916.235694:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 386: rc = 0 00100000:10000000:3.0:1790096916.236081:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1790096916.236473:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.236736:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1790096916.236975:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.240417:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1790096916.240817:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.241069:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1790096916.242954:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.243319:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.243578:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1790096916.243956:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1790096916.244216:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1790096916.246567:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 689: rc = 0 00100000:10000000:3.0:1790096916.248627:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 689: rc = 0 00100000:10000000:3.0:1790096916.250427:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 689: rc = 0 00100000:10000000:3.0:1790096916.250793:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 689: rc = 0 00100000:10000000:3.0:1790096916.251027:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 689: rc = 0 00100000:10000000:3.0:1790096916.251515:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 689: rc = 0 00100000:10000000:3.0:1790096916.251892:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 689: rc = 0 00100000:10000000:3.0:1790096916.252151:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 689: rc = 0 00100000:10000000:3.0:1790096916.252537:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 689: rc = 0 00100000:10000000:3.0:1790096916.254622:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 689: rc = 0 00100000:10000000:3.0:1790096916.255891:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 689: rc = 0 00100000:10000000:3.0:1790096916.256167:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 689: rc = 0 00100000:10000000:3.0:1790096916.258842:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 689: rc = 0 00100000:10000000:3.0:1790096916.259096:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 689: rc = 0 00100000:10000000:3.0:1790096916.259479:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 689: rc = 0 00100000:10000000:3.0:1790096916.259846:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 689: rc = 0 00100000:10000000:3.0:1790096916.260086:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 689: rc = 0 00100000:10000000:3.0:1790096916.262136:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 689: rc = 0 00100000:10000000:3.0:1790096916.273016:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 689: rc = 0 00100000:10000000:3.0:1790096916.275144:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 689: rc = 0 00100000:10000000:3.0:1790096916.277147:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 689: rc = 0 00100000:10000000:3.0:1790096916.281052:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 689: rc = 0 00100000:10000000:3.0:1790096916.281338:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 689: rc = 0 00100000:10000000:3.0:1790096916.281584:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 689: rc = 0 00100000:10000000:3.0:1790096916.282128:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 689: rc = 0 00100000:10000000:3.0:1790096916.284071:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 689: rc = 0 00100000:10000000:3.0:1790096916.286968:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 689: rc = 0 00100000:10000000:3.0:1790096916.287307:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 689: rc = 0 00100000:10000000:3.0:1790096916.287549:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 689: rc = 0 00100000:10000000:3.0:1790096916.290112:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 689: rc = 0 00100000:10000000:3.0:1790096916.290564:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 689: rc = 0 00100000:10000000:3.0:1790096916.294883:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 689: rc = 0 00100000:10000000:3.0:1790096916.295596:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:3.0:1790096916.299102:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790096916.299629:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 387: rc = 0 00100000:10000000:3.0:1790096916.299847:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790096916.299909:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 387: rc = 0 00100000:10000000:3.0:1790096916.300110:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790096916.300615:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 387: rc = 0 00100000:10000000:2.0:1790096916.301062:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790096916.301329:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 315: rc = 0 00100000:10000000:2.0:1790096916.301512:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790096916.301573:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 315: rc = 0 00100000:10000000:1.0:1790096916.305954:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1790096916.306053:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 315: rc = 0 00000020:00000080:1.0:1790096916.306449:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790096916.306456:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790096916.306469:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab689c 00000020:01000004:1.0:1790096916.306476:0:14419:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790096916.306481:0:14419:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790096916.306485:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea9c3140800 from MGS 00000020:01000004:1.0:1790096916.306489:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790096916.306497:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9eaad1860000) 00000020:00000080:1.0:1790096916.306505:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790096916.306554:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea9c3140800 from MGS, refs=2 00080000:01000000:1.0:1790096916.306558:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790096916.306562:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab68aa 00000100:00100000:1.0:1790096916.306756:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790096916.307032:0:14419:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790096916.307038:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790096916.307619:0:14419:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790096916.307625:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790096916.308354:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096916.308501:0:14419:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790096916.308506:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790096916.308927:0:14419:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790096916.308934:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790096916.309182:0:14419:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790096916.309374:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790096916.310006:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.310009:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.310011:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.310360:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.310369:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.310371:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096916.310905:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790096916.314558:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790096916.324013:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790096916.324030:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790096916.324032:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790096916.335730:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790096916.336027:0:14419:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790096916.336146:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790096916.336830:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790096916.337129:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096916.337428:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790096916.337435:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790096916.338125:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790096916.338133:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790096916.338617:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790096916.338624:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1790096916.339398:0:14432:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1790096916.339558:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790096916.339580:0:14419:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:2.0:1790096916.339582:0:14419:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790096916.339618:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:2.0:1790096916.339735:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (ffff9eaafbcb19c0) 00000020:00000080:2.0:1790096916.339752:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790096916.339829:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea9c3145800@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790096916.339978:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:2.0:1790096916.339985:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790096916.367333:0:14435:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790096916.367404:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid cee436cd-c034-4d15-b596-e9f7d5252125) 00000020:00000080:2.0:1790096916.367429:0:14419:0:(genops.c:1384:class_connect()) connect: client cee436cd-c034-4d15-b596-e9f7d5252125, cookie 0xcc97d9eae5ab68b8 00000100:00080000:2.0:1790096916.367443:0:14419:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790096916.367457:0:14419:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff9ea9c3145800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096916.367489:0:14419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaad57e4000 x1877052324138368/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790096916.367511:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cee436cd-c034-4d15-b596-e9f7d5252125->MGS 00000020:01000004:2.0:1790096916.367527:0:14419:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790096916.367532:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790096916.367546:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9eaafbcb0000) 00000020:00000080:2.0:1790096916.367557:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790096916.372827:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cee436cd-c034-4d15-b596-e9f7d5252125:3313:1877052324138368:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790096916.372904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096916.372997:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324138368 00000100:00100000:3.0:1790096916.373005:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324138368 00000100:00100000:3.0:1790096916.373034:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096916.373041:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1877052324138368:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790096916.373067:0:14429:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cee436cd-c034-4d15-b596-e9f7d5252125@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1790096916.373095:0:14429:0:(genops.c:1384:class_connect()) connect: client cee436cd-c034-4d15-b596-e9f7d5252125, cookie 0xcc97d9eae5ab68c6 00000100:00080000:3.0:1790096916.373239:0:14429:0:(import.c:65:import_set_state_nolock()) ffff9eaad184d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790096916.373291:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+5:3313:x1877052324138368:12345-0@lo:250:mount.lustre.0 Request processed in 247us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.373299:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096916.373338:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790096916.373345:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1790096916.373352:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790096916.373356:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790096916.373360:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9ea9c3145800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790096916.373362:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790096916.373368:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790096916.373373:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cee436cd-c034-4d15-b596-e9f7d5252125:3313:1877052324138368:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790096916.388516:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790096916.388727:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790096916.388734:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790096916.391078:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790096916.391091:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790096916.391659:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790096916.391666:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790096916.392444:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790096916.392616:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790096916.392621:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790096916.394452:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790096916.394467:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790096916.471849:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096916.472284:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790096916.472451:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790096916.482834:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790096916.482847:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790096916.483628:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096916.483829:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790096916.483834:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790096916.484784:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790096916.484795:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790096916.485475:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096916.485667:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790096916.485853:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790096916.486567:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790096916.486576:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790096916.487405:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790096916.487580:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790096916.487587:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790096916.488574:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790096916.488583:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790096916.511007:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096916.513150:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790096916.513244:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790096916.515027:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790096916.515098:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790096916.518850:0:14419:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790096916.518868:0:14419:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790096916.520359:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790096916.520384:0:14419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790096916.520390:0:14419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790096916.520602:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790096916.520768:0:14419:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790096916.520773:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790096916.520774:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790096916.520776:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096916.520777:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096916.520778:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096916.520779:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096916.520781:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790096916.520782:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790096916.520784:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096916.520785:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790096916.520793:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790096916.520795:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790096916.520796:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790096916.520797:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096916.520798:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096916.520799:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096916.520800:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096916.520801:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790096916.520802:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790096916.520803:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096916.520804:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790096916.520843:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790096916.520866:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790096916.520940:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.520984:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.521065:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324138496 00000100:00100000:2.0:1790096916.521072:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324138496 00000100:00100000:2.0:1790096916.521113:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096916.521123:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+5:14419:x1877052324138496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790096916.521298:0:14431:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790096916.521302:0:14431:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790096916.521305:0:14431:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790096916.521756:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790096916.522144:0:14431:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1790096916.532219:0:14454:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1790096916.532227:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1790096916.532230:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1790096916.532267:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790096916.532830:0:14431:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790096916.532841:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790096916.551754:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+5:14419:x1877052324138496:12345-0@lo:253:mount.lustre.0 Request processed in 30621us (30803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.551768:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096916.551963:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790096916.551979:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790096916.551983:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096916.551984:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790096916.551986:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096916.551987:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096916.551988:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096916.551989:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096916.551991:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790096916.551992:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790096916.551994:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096916.551995:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790096916.552029:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea9c3140800 from lustre-MDT0000 10000000:01000000:0.0:1790096916.552053:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790096916.552056:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790096916.552061:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eaafbcb19c0 10000000:01000000:0.0:1790096916.552384:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790096916.552395:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eaafbcb19c0 from 1 10000000:01000000:0.0:1790096916.552398:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790096916.552439:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.552450:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.552459:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.552480:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790096916.552518:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.552563:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe480 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.552618:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324138624 00000100:00100000:2.0:1790096916.552625:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324138624 00000100:00100000:2.0:1790096916.552697:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096916.552706:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+5:14419:x1877052324138624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096916.552720:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096916.552741:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8400/0xcc97d9eae5ab68d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab68cd expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.552763:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8400/0xcc97d9eae5ab68d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68cd expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.552773:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8400/0xcc97d9eae5ab68d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68cd expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.552780:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8400, rc 0) 00000100:00100000:2.0:1790096916.552817:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+6:14419:x1877052324138624:12345-0@lo:101:mount.lustre.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.552822:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790096916.552953:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096916.552966:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.552974:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.553033:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096916.553058:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.553123:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.553283:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324138752 00000100:00100000:3.0:1790096916.553288:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324138752 00000100:00100000:3.0:1790096916.553324:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790096916.553332:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+6:14419:x1877052324138752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096916.553717:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+6:14419:x1877052324138752:12345-0@lo:501:mount.lustre.0 Request processed in 384us (656us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790096916.553724:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790096916.553833:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790096916.553865:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790096916.553883:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.553893:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096916.553901:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea9c3140800 10000000:01000000:1.0:1790096916.553913:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790096916.553918:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ea9c3140800 10000000:01000000:1.0:1790096916.553920:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790096916.553923:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ea9c3140800 from 1 10000000:01000000:1.0:1790096916.553926:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790096916.553949:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.553958:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.553966:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.553979:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790096916.554006:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.554039:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac9690780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.554665:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324138880 00000100:00100000:2.0:1790096916.554672:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324138880 00000100:00100000:2.0:1790096916.554707:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096916.554714:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+6:14419:x1877052324138880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096916.554725:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096916.554738:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db9e00/0xcc97d9eae5ab68e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab68db expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.554757:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db9e00/0xcc97d9eae5ab68e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68db expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.554766:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db9e00/0xcc97d9eae5ab68e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68db expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.554774:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9e00, rc 0) 00000100:00100000:2.0:1790096916.554823:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+7:14419:x1877052324138880:12345-0@lo:101:mount.lustre.0 Request processed in 110us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.554844:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790096916.554936:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324138880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096916.554950:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68e2 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.554958:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab68e2 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096916.554971:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790096916.554975:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68e2 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.554982:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148e600/0xcc97d9eae5ab68db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68e2 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096916.554995:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790096916.554999:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790096916.555004:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ea9c3140800 10000000:01000000:1.0:1790096916.555006:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790096916.555009:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790096916.555021:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790096916.555039:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.555046:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.555054:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.555069:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790096916.555106:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.555134:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac9690780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.555305:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139008 00000100:00100000:2.0:1790096916.555310:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139008 00000100:00100000:2.0:1790096916.555339:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096916.555346:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+7:14419:x1877052324139008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096916.555353:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096916.555361:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab68f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab68e9 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.555376:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab68f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68e9 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.555385:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db9800/0xcc97d9eae5ab68f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab68e9 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.555391:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db9800, rc 0) 00000100:00100000:2.0:1790096916.555423:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+8:14419:x1877052324139008:12345-0@lo:101:mount.lustre.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.555430:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790096916.555740:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096916.555751:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.555757:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab68f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.555807:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096916.555832:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.555870:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac9690780 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.555923:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139136 00000100:00100000:3.0:1790096916.555927:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139136 00000100:00100000:3.0:1790096916.555959:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790096916.555966:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+8:14419:x1877052324139136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096916.556839:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+9:14419:x1877052324139136:12345-0@lo:501:mount.lustre.0 Request processed in 871us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.556847:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790096916.557602:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096916.557688:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096916.557740:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.557777:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac9690780 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.557850:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139264 00000100:00100000:2.0:1790096916.557857:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139264 00000100:00100000:2.0:1790096916.557896:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096916.557904:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+9:14419:x1877052324139264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790096916.558431:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+9:14419:x1877052324139264:12345-0@lo:503:mount.lustre.0 Request processed in 527us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.558439:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790096916.559140:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096916.560878:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14455:1877052324139392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096916.560948:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.560996:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5708300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.561119:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139392 00000100:00100000:3.0:1790096916.561127:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139392 00000100:00100000:3.0:1790096916.561173:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790096916.561316:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+9:14455:x1877052324139392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096916.561691:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+9:14455:x1877052324139392:12345-0@lo:502:llog_process_th.0 Request processed in 509us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.561700:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790096916.567269:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14455:1877052324139392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790096916.567346:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096916.567367:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.567370:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790096916.567380:0:14455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790096916.567384:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096916.567411:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9eaad18619c0) 00000020:00000080:1.0:1790096916.567445:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790096916.567451:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790096916.567583:0:14455:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790096916.567593:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab68fe 00000020:00000080:1.0:1790096916.567895:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790096916.567901:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096916.567906:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.567907:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790096916.567909:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096916.567913:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.567915:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790096916.567918:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096916.567932:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9eaad1863380) 00000020:00000080:1.0:1790096916.567942:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790096916.567946:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790096916.567948:0:14455:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790096916.567952:0:14455:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790096916.567957:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790096916.568006:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea9c3140800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790096916.568035:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9eaad1864d40) 00000020:00000080:1.0:1790096916.568043:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790096916.568098:0:14455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790096916.568104:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab6913 00000020:00000080:1.0:1790096916.568194:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790096916.568201:0:14455:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790096916.568215:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc97d9eae5ab691a 00080000:01000000:1.0:1790096916.568220:0:14455:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790096916.568224:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab6921 00010000:00010000:2.0:1790096916.674794:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790096916.675432:0:14455:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1790096916.675668:0:14455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790096916.678969:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9eaafbcb3380) 00000020:00000080:2.0:1790096916.678990:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790096916.679344:0:14455:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790096916.679353:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab692f 00000020:00000080:3.0:1790096916.684919:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790096916.697273:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc97d9eae5ab6936 00000020:00000080:3.0:1790096916.697943:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790096916.697955:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096916.697962:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096916.697964:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790096916.697967:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790096916.697970:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1790096916.697971:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790096916.697973:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790096916.697974:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790096916.697976:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096916.697978:0:14455:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790096916.697980:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096916.697984:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096916.697986:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790096916.697990:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790096916.698040:0:14455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790096916.698052:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096916.698056:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096916.698058:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790096916.698060:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790096916.698062:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790096916.698065:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096916.698066:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790096916.698069:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790096916.698083:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1790096916.698108:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790096916.698111:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790096916.698125:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eaaef59b380) 00000020:00000080:3.0:1790096916.698140:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790096916.698144:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790096916.698383:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790096916.698390:0:14455:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790096916.698405:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab6944 00010000:00080000:3.0:1790096916.698438:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaaee992000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790096916.698755:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790096916.699625:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790096916.701401:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790096916.702729:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790096916.702785:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790096916.702841:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790096916.703577:0:14459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790096916.703583:0:14459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790096916.704401:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790096916.704411:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790096916.704441:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790096916.704460:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab694b 00000100:00080000:1.0:1790096916.704471:0:14455:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790096916.704483:0:14455:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eaaee992000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096916.704518:0:14455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaffe98700 x1877052324139520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790096916.704541:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790096916.704595:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096916.704599:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.704601:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790096916.704603:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790096916.704606:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790096916.704607:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790096916.704609:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790096916.704618:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790096916.704620:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.704622:0:14455:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790096916.704624:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790096916.704629:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790096916.704667:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.704669:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790096916.704673:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790096916.704677:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1790096916.704700:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790096916.704703:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790096916.704776:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eaafc83cd40) 00000020:00000080:1.0:1790096916.704788:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790096916.704794:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790096916.704843:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790096916.704848:0:14455:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790096916.704852:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc97d9eae5ab6959 00010000:00080000:1.0:1790096916.704877:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaaef5a9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:3.0:1790096916.705295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324139520:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790096916.705345:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877052324139520 offset 0 length 520: 4 00010000:00010000:1.0:1790096916.705507:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790096916.705779:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790096916.705802:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790096916.707485:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096916.707568:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1790096916.707655:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790096916.708894:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790096916.708900:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790096916.709504:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790096916.709516:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790096916.709547:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790096916.709565:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab6960 00000100:00080000:2.0:1790096916.709575:0:14455:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790096916.709586:0:14455:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096916.709619:0:14455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaad57e6d80 x1877052324139648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790096916.711303:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790096916.711394:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096916.711401:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096916.711403:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790096916.711407:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096916.711508:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096916.711511:0:14455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790096916.711516:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790096916.711518:0:14455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790096916.711520:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096916.711523:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096916.711524:0:14455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790096916.711526:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790096916.711528:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096916.711529:0:14455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790096916.711547:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790096916.711589:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14455:1877052324139776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096916.711805:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096916.711842:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad86c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096916.711971:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324139648:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790096916.712005:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877052324139648 offset 0 length 520: 4 00000100:00100000:2.0:1790096916.712473:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139776 00000100:00100000:2.0:1790096916.712480:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139776 00000100:00100000:2.0:1790096916.712519:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096916.712527:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+9:14455:x1877052324139776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096916.713629:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+9:14455:x1877052324139776:12345-0@lo:502:llog_process_th.0 Request processed in 1095us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.713949:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096916.714263:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14455:1877052324139776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790096916.714299:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790096916.714305:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790096916.714308:0:14455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790096916.714314:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790096916.716531:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790096916.716562:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790096916.716588:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.716615:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148ee00/0xcc97d9eae5ab68e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096916.716624:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea9c3140800 from 1 10000000:01000000:0.0:1790096916.716627:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790096916.716855:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.716863:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.716874:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.716898:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790096916.716958:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.717275:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.717357:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324139904 00000100:00100000:2.0:1790096916.717365:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324139904 00000100:00100000:2.0:1790096916.717418:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790096916.717427:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+9:14419:x1877052324139904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096916.717439:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096916.717453:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6967 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.717474:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.717483:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096916.717499:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8a00, rc 0) 00000100:00100000:2.0:1790096916.717607:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+10:14419:x1877052324139904:12345-0@lo:101:mount.lustre.0 Request processed in 181us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096916.717614:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790096916.717729:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324139904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096916.717743:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.717758:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.718533:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140032:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790096916.718596:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.718782:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c1935180 going to sleep for 11 seconds 00000100:00100000:0.0:1790096916.718830:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140032 00000100:00100000:0.0:1790096916.718836:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140032 00000100:00100000:0.0:1790096916.718909:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790096916.718918:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+10:14419:x1877052324140032:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790096916.718934:0:14430:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790096916.718940:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790096916.719023:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+10:14419:x1877052324140032:12345-0@lo:256:mount.lustre.0 Request processed in 106us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096916.719030:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790096916.719105:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140032:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790096916.719965:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790096916.719991:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.720005:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096916.720022:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea9c3140800 from 1 10000000:01000000:1.0:1790096916.720024:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096916.720056:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.720064:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.720131:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.720152:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790096916.720267:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.720678:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c1935180 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.720839:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140160 00000100:00100000:2.0:1790096916.720847:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140160 00000100:00100000:3.0:1790096916.721197:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790096916.721216:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+10:14419:x1877052324140160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790096916.721230:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096916.721248:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6975 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096916.721299:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096916.721310:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096916.721319:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6800, rc 0) 00000100:00100000:3.0:1790096916.721372:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140160:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.721379:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790096916.721447:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096916.721472:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.721482:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.721538:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096916.721569:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.721902:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe780 going to sleep for 11 seconds 00000100:00100000:1.0:1790096916.721966:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140288 00000100:00100000:1.0:1790096916.721972:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140288 00000100:00100000:1.0:1790096916.721996:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790096916.722003:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096916.722538:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140288:12345-0@lo:501:mount.lustre.0 Request processed in 533us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096916.722545:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096916.722790:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096916.722827:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790096916.722869:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.722883:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe780 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.722935:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140416 00000100:00100000:3.0:1790096916.722940:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140416 00000100:00100000:3.0:1790096916.722969:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790096916.722981:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790096916.723371:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140416:12345-0@lo:503:mount.lustre.0 Request processed in 390us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.723379:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790096916.723449:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096916.723761:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14463:1877052324140544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096916.723794:0:14463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.723823:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c1935c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.723884:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140544 00000100:00100000:3.0:1790096916.723889:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140544 00000100:00100000:3.0:1790096916.723911:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790096916.723916:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+11:14463:x1877052324140544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096916.724352:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+11:14463:x1877052324140544:12345-0@lo:502:llog_process_th.0 Request processed in 369us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.724361:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790096916.724439:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14463:1877052324140544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790096916.724466:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096916.724475:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.724478:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790096916.724485:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea9c3140800 00000020:00000080:1.0:1790096916.724488:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790096916.724495:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096916.724498:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.724499:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790096916.724501:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096916.724504:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.724505:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790096916.724508:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea9c3140800 00000020:00000080:1.0:1790096916.724510:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790096916.724575:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096916.724579:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.724580:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790096916.724582:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096916.724584:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096916.724591:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790096916.724596:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea9c3140800 00000020:00000080:1.0:1790096916.724598:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790096916.724703:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14463:1877052324140672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790096916.724741:0:14463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.725175:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea9c1935c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096916.728329:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140672 00000100:00100000:2.0:1790096916.728344:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140672 00000100:00100000:0.0:1790096916.728525:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790096916.728537:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14463:x1877052324140672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790096916.728822:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14463:x1877052324140672:12345-0@lo:502:llog_process_th.0 Request processed in 286us (4079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096916.728830:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790096916.728900:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14463:1877052324140672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790096916.728939:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096916.728947:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096916.728949:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790096916.728954:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790096916.729026:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790096916.729048:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096916.729069:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731354:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096916.731413:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790096916.731416:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea9c3140800 10000000:01000000:0.0:1790096916.731419:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea9c3140800 10000000:01000000:0.0:1790096916.731423:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790096916.731429:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea9c3140800 from 1 10000000:01000000:0.0:1790096916.731431:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790096916.731469:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731478:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731489:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.731513:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790096916.731579:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.731623:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096916.731681:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140800 00000100:00100000:0.0:1790096916.731688:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140800 00000100:00100000:0.0:1790096916.731729:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790096916.731737:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324140800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096916.731749:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096916.731772:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690a00/0xcc97d9eae5ab698a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6983 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731794:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690a00/0xcc97d9eae5ab698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6983 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731804:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690a00/0xcc97d9eae5ab698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6983 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731812:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690a00, rc 0) 00000100:00100000:0.0:1790096916.731848:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324140800:12345-0@lo:101:mount.lustre.0 Request processed in 112us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096916.731855:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790096916.731903:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096916.731916:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab698a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096916.731924:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab698a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096916.731969:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096916.731992:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096916.732023:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfed80 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.733344:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324140928 00000100:00100000:3.0:1790096916.733355:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324140928 00000100:00100000:3.0:1790096916.733400:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790096916.733409:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324140928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096916.733726:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324140928:12345-0@lo:501:mount.lustre.0 Request processed in 317us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.733735:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790096916.734248:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324140928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096916.734301:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324141056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790096916.734349:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096916.734381:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096916.734499:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141056 00000100:00100000:0.0:1790096916.734505:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141056 00000100:00100000:0.0:1790096916.734547:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790096916.734556:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324141056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790096916.734723:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324141056:12345-0@lo:503:mount.lustre.0 Request processed in 168us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096916.734736:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790096916.734891:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324141056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790096916.740431:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14465:1877052324141184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790096916.740516:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096916.740565:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.742349:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141184 00000100:00100000:3.0:1790096916.742361:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141184 00000100:00100000:3.0:1790096916.742410:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790096916.742419:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:14465:x1877052324141184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096916.742716:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:14465:x1877052324141184:12345-0@lo:502:llog_process_th.0 Request processed in 297us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.742724:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790096916.742787:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14465:1877052324141184:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790096916.742857:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790096916.742872:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9eaaef59cd40) 00000020:00000080:3.0:1790096916.742890:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790096916.742975:0:14465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea9c3140800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790096916.742979:0:14465:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea9c3140800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790096916.742981:0:14465:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea9c3140800 4 00010000:00080000:3.0:1790096916.743024:0:14465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaaff5d0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790096916.749584:0:14465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790096916.749802:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790096916.749835:0:14465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790096916.749848:0:14465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc97d9eae5ab6998 00000100:00080000:3.0:1790096916.749858:0:14465:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790096916.749868:0:14465:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eaaff5d0000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096916.749906:0:14465:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b7ad80 x1877052324141312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790096916.749930:0:14465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790096916.752034:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324141312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790096916.752117:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.752228:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141312 00000100:00100000:1.0:1790096916.752235:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141312 00000100:00100000:1.0:1790096916.752278:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096916.752284:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324141312:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790096916.752346:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324141312:12345-0@lo:38:llog_process_th.0 Request processed in 60us (228us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790096916.752353:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096916.752386:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790096916.752393:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790096916.752397:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790096916.752401:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324141312:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790096916.754842:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14465:1877052324141440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096916.754926:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096916.754965:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141440 00000100:00100000:3.0:1790096916.754971:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141440 00000100:00100000:3.0:1790096916.755018:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096916.755028:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:14465:x1877052324141440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790096916.755283:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:14465:x1877052324141440:12345-0@lo:502:llog_process_th.0 Request processed in 256us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096916.755302:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790096916.755355:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.755378:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cee436cd-c034-4d15-b596-e9f7d5252125:14465:1877052324141440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790096916.755410:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790096916.755466:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790096916.755484:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790096916.755501:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab698a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096916.755512:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691200/0xcc97d9eae5ab6983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab698a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790096916.755551:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790096916.755553:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790096916.755555:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096916.755556:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096916.755558:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096916.755559:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096916.755561:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790096916.755562:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790096916.755564:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096916.755565:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790096916.755569:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790096916.755571:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096916.755573:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790096916.755574:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096916.755575:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096916.755576:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096916.755577:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096916.755578:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790096916.755579:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790096916.755580:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096916.755581:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790096916.755595:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790096916.755604:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324141568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790096916.755659:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096916.755673:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096916.755696:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141568 00000100:00100000:3.0:1790096916.755705:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141568 00000100:00100000:3.0:1790096916.755728:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790096916.755733:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14419:x1877052324141568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790096916.755752:0:14429:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790096916.755764:0:14429:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790096916.796391:0:14429:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790096916.796404:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790096916.796446:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790096916.796450:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790096916.796472:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796490:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796514:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796551:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796565:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 12 pid: 14429 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.796580:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324141696:0@lo:104: 00000100:00100000:1.0:1790096916.796665:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.796704:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00000100:00100000:1.0:1790096916.796738:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141696 00000100:00100000:1.0:1790096916.796745:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141696 00000100:00100000:1.0:1790096916.796785:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096916.796794:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324141696:12345-0@lo:104: 00010000:00010000:1.0:1790096916.796808:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796853:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790096916.796859:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324141696:12345-0@lo:104: Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096916.796866:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790096916.796889:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096916.796896:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796903:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096916.796913:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796921:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096916.796928:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096916.796934:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790096916.796961:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796967:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096916.796986:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.796993:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac8690200/0xcc97d9eae5ab6967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab696e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797009:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.797021:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096916.797023:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096916.797050:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324141824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096916.797086:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096916.797147:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141824 00000100:00100000:1.0:1790096916.797151:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141824 00010000:00010000:1.0:1790096916.797167:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 13 pid: 14429 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.797187:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096916.797198:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+13:3315:x1877052324141824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096916.797220:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096916.797226:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 13 pid: 14429 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797237:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 13 pid: 14429 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797253:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797260:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790096916.797272:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000823364s 00010000:00010000:1.0:1790096916.797277:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797285:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797291:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797297:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797303:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096916.797307:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797326:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797336:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797346:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096916.797372:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+13:3315:x1877052324141824:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096916.797379:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790096916.797410:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324141824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096916.797431:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaae8db8a00/0xcc97d9eae5ab696e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab6967 expref: 12 pid: 14429 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.797440:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324141696:0@lo:104: 00010000:00010000:1.0:1790096916.797453:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797462:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797469:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096916.797475:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f600/0xcc97d9eae5ab699f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096916.808891:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+11:14419:x1877052324141568:12345-0@lo:253:mount.lustre.0 Request processed in 53148us (53222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096916.808921:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790096916.809039:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:14419:1877052324141568:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790096916.809055:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790096916.809058:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790096916.809060:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790096916.809061:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096916.809062:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096916.809063:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096916.809064:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096916.809066:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790096916.809067:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790096916.809069:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096916.809070:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790096916.809098:0:14419:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790096916.814408:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790096916.814577:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790096916.814908:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790096916.815065:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790096916.815556:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790096916.815743:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790096916.817349:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096916.817516:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790096916.817777:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096916.817994:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790096916.818434:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790096916.818576:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790096916.841575:0:14419:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790096916.842367:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1790096916.842612:0:14476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1790096916.842720:0:14476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1790096916.845911:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:1.0:1790096916.847374:0:14475:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790096916.847380:0:14475:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1790096916.847539:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790096916.848800:0:14476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790096916.848875:0:14476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790096916.848879:0:14476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1790096916.849291:0:14419:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790096916.849306:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790096916.849575:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096916.851403:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790096916.852352:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790096916.852397:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790096916.853291:0:14419:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1790096916.854496:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790096916.861864:0:14419:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790096916.896443:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790096916.896482:0:14419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9f41cdb988 00100000:10000000:3.0:1790096916.896501:0:14419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790096916.897976:0:14419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790096916.897993:0:14419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790096916.898025:0:14419:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790096916.898094:0:14419:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790096917.378987:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790096917.692720:0:14435:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790096917.692728:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea9c3140800 from 6 10000000:01000000:1.0:1790096917.692733:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790096917.692790:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096917.692801:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096917.692813:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096917.692839:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324141952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096917.692916:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096917.692965:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096917.696699:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324141952 00000100:00100000:3.0:1790096917.696715:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324141952 00000100:00100000:3.0:1790096917.696789:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790096917.696800:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+11:14435:x1877052324141952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096917.696817:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096917.696837:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab69a6 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096917.697029:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096917.697042:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096917.697052:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096917.697135:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:14435:x1877052324141952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096917.697142:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096917.697250:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324141952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096917.697267:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096917.697290:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096917.697352:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324142080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790096917.697387:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096917.697425:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096917.697535:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142080 00000100:00100000:3.0:1790096917.697539:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142080 00000100:00100000:3.0:1790096917.697570:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790096917.697576:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14435:x1877052324142080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790096917.697590:0:14429:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790096917.697606:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790096917.697609:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790096917.697710:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14435:x1877052324142080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096917.697717:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790096917.697748:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324142080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790096917.697952:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790096917.697961:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096917.697969:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790096917.838562:0:14471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790096917.838572:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790096917.841217:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1790096917.841227:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790096918.396903:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790096918.846482:0:14471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790096918.846491:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790096918.846788:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1790096918.846795:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790096919.429291:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096920.446811:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096921.468797:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790096921.983719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790096921.983726:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790096921.983729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790096921.983732:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790096921.983734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790096921.983737:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790096921.983740:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790096921.983755:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eaaff5d0000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096921.983775:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaffe9aa00 x1877052324142336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790096921.983835:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096921.983847:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324142208:0@lo:400:kworker.0 00000100:00100000:1.0:1790096921.983916:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096921.983979:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142208 00000100:00100000:1.0:1790096921.983987:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142208 00000100:00100000:1.0:1790096921.984027:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790096921.984035:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:3317:x1877052324142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096921.984093:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:3317:x1877052324142208:12345-0@lo:400:kworker.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096921.984100:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790096921.984473:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324142208:0@lo:400:kworker.0 00000100:00100000:0.0:1790096921.984578:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324142336:0@lo:38:kworker.0 00000100:00100000:0.0:1790096921.984632:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096921.985773:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142336 00000100:00100000:1.0:1790096921.985783:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142336 00000100:00100000:1.0:1790096921.985822:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096921.985829:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1877052324142336:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790096921.985856:0:14439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:1.0:1790096921.985892:0:14439:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc97d9eae5ab69b4 00000004:00100000:1.0:1790096921.985907:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790096921.998835:0:14439:0:(import.c:65:import_set_state_nolock()) ffff9eaaff079000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096921.998949:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877052324142336:12345-0@lo:38:kworker.0 Request processed in 13115us (14312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096921.998965:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790096921.999022:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaffe9aa00 x1877052324142336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790096921.999039:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790096921.999054:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790096921.999059:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790096921.999062:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaff5d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790096921.999069:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877052324142336:0@lo:38:kworker.0 00010000:00010000:1.0:1790096922.493131:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096922.670448:0:14720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790096923.516789:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096924.541316:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096925.580330:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096926.077984:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790096916/real 1790096916] req@ffff9eaad57e6d80 x1877052324139648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096926.078035:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eaad57e6d80 x1877052324139648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096926.078047:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790096916/real 1790096916] req@ffff9eaaffe98700 x1877052324139520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096926.078060:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eaaffe98700 x1877052324139520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790096926.078078:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790096926.078108:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790096926.078112:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324139648:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790096926.078119:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaee992000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790096926.078124:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790096926.078127:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324139520:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790096926.078554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096926.078559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790096926.078561:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaee992000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790096926.078566:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1790096926.078571:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790096926.078581:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eaaee992000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096926.078601:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b78e00 x1877052324142592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790096926.078626:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096926.078630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790096926.078631:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790096926.078661:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1790096926.078664:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790096926.078669:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096926.078684:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b7b480 x1877052324142720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096926.078724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324142848:0@lo:400:kworker.0 00000100:00100000:3.0:1790096926.078792:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096926.078871:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142848 00000100:00100000:3.0:1790096926.078880:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142848 00000100:00100000:3.0:1790096926.078923:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096926.078932:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096926.078980:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324142848:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096926.078988:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790096926.079025:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaf3b7ad80 x1877052324142848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096926.079035:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324142848:0@lo:400:kworker.0 00000100:00100000:3.0:1790096926.079055:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324142592:0@lo:8:kworker.0 00000400:00000100:3.0:1790096926.079075:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877052324142592 offset 0 length 520: 4 00000100:00100000:3.0:1790096926.079093:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324142720:0@lo:8:kworker.0 00000400:00000100:3.0:1790096926.079122:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877052324142720 offset 0 length 520: 4 00000100:00100000:2.0:1790096926.080796:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096926.080831:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324142464:0@lo:400:kworker.0 00000100:00100000:1.0:1790096926.080905:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096926.081303:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142464 00000100:00100000:2.0:1790096926.081311:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142464 00000100:00100000:2.0:1790096926.081360:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790096926.081369:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:3316:x1877052324142464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096926.081429:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:3316:x1877052324142464:12345-0@lo:400:kworker.0 Request processed in 61us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096926.081437:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790096926.081539:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324142464:0@lo:400:kworker.0 00010000:00010000:3.0:1790096926.588848:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790096926.887483:0:14871:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd735d0cc0 20000000:00000080:0.0:1790096926.887507:0:14871:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaafca38000 uarg=0000000000000000 20000000:01000000:0.0:1790096926.887549:0:14871:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790096926.887558:0:14871:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790096926.887564:0:14871:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790096926.889560:0:14872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790096926.890107:0:14871:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790096926.904703:0:14871:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790096926.904746:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.904772:0:14871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.904781:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.904840:0:14871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.904857:0:14871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096926.904873:0:14871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14871:1877052324142976:0@lo:104: 00000100:00100000:0.0:1790096926.904974:0:14871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096926.906392:0:14871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0330b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790096926.907364:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324142976 00000100:00100000:1.0:1790096926.907381:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324142976 00000100:00100000:1.0:1790096926.907448:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096926.907460:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cee436cd-c034-4d15-b596-e9f7d5252125+3:14871:x1877052324142976:12345-0@lo:104: 00010000:00010000:1.0:1790096926.907483:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907598:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790096926.907606:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cee436cd-c034-4d15-b596-e9f7d5252125+3:14871:x1877052324142976:12345-0@lo:104: Request processed in 148us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096926.907614:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790096926.907666:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096926.907673:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907701:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fc00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096926.907706:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907716:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096926.907723:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096926.907729:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790096926.907772:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907779:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096926.907805:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907814:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148fc00/0xcc97d9eae5ab6975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab697c expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.907836:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096926.907838:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096926.907839:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096926.907862:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324143104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096926.907903:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096926.907960:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143104 00000100:00100000:1.0:1790096926.907965:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143104 00010000:00010000:1.0:1790096926.907987:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 12 pid: 14431 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096926.908080:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096926.908088:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+12:3315:x1877052324143104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096926.908100:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096926.908106:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 12 pid: 14431 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908118:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 12 pid: 14431 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908150:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908160:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908177:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908184:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908191:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908197:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908202:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096926.908207:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908221:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908231:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096926.908241:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096926.908271:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+12:3315:x1877052324143104:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096926.908278:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790096926.908321:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324143104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096926.909657:0:14871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaaffcf6800/0xcc97d9eae5ab697c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab6975 expref: 11 pid: 14431 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096926.909682:0:14871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14871:1877052324142976:0@lo:104: 00010000:00010000:0.0:1790096926.909708:0:14871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.909719:0:14871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.909725:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096926.909730:0:14871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab69bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096927.614524:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790096928.062235:0:14471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790096928.062245:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096928.062694:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790096928.062760:0:14471:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096928.062792:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1790096928.641249:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790096928.839206:0:14435:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790096928.839214:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea9c3140800 from 10 10000000:01000000:3.0:1790096928.839220:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790096928.839269:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096928.839281:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096928.839292:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096928.839319:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.839387:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096928.839430:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac4f1b240 going to sleep for 11 seconds 00000100:00100000:1.0:1790096928.839561:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143232 00000100:00100000:1.0:1790096928.839568:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143232 00000100:00100000:1.0:1790096928.839615:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790096928.839624:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+11:14435:x1877052324143232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096928.839665:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096928.839678:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab69c2 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096928.839698:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096928.839721:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096928.839729:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fc00, rc 0) 00000100:00100000:1.0:1790096928.839764:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:14435:x1877052324143232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096928.839770:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790096928.839874:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096928.839887:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096928.839894:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096928.839943:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.839969:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096928.839989:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac4f1b240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096928.840002:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143360 00000100:00100000:3.0:1790096928.840013:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143360 00000100:00100000:3.0:1790096928.840031:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790096928.840038:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+13:14435:x1877052324143360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.840284:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+13:14435:x1877052324143360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096928.840291:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790096928.840333:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.840359:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.840396:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096928.840411:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac4f1b240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096928.840422:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143488 00000100:00100000:3.0:1790096928.840425:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143488 00000100:00100000:3.0:1790096928.840440:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790096928.840444:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+13:14435:x1877052324143488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096928.840578:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+13:14435:x1877052324143488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096928.840584:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790096928.840613:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324143488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790096928.841413:0:14938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790096928.841467:0:14435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790096928.841479:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790096928.841487:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096928.841496:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096929.660908:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096930.684853:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790096931.205007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096931.205014:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790096931.205016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096931.205020:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790096931.205051:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324143616:0@lo:400:kworker.0 00000100:00100000:3.0:1790096931.205136:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096931.205183:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790096931.205189:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324143744:0@lo:400:kworker.0 00000100:00100000:3.0:1790096931.205213:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096931.205245:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143616 00000100:00100000:3.0:1790096931.205253:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143616 00000100:00100000:3.0:1790096931.205298:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790096931.205306:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:3316:x1877052324143616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096931.205356:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+12:3316:x1877052324143616:12345-0@lo:400:kworker.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096931.205363:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790096931.205395:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143744 00000100:00100000:3.0:1790096931.205399:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143744 00000100:00100000:3.0:1790096931.205421:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790096931.205427:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324143744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096931.205460:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324143744:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096931.205466:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790096931.205514:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaf3b7b800 x1877052324143744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096931.205526:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324143744:0@lo:400:kworker.0 00000100:00100000:3.0:1790096931.205535:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324143616:0@lo:400:kworker.0 00010000:00010000:0.0:1790096931.721831:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096932.735879:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790096933.756693:0:15121:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790096933.756697:0:15121:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790096933.756808:0:15121:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eaaff0eb000 00000020:01000004:1.0:1790096933.756824:0:15121:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790096933.756836:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790096933.756849:0:15121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eaafc8399c0) 00000020:00000080:1.0:1790096933.756864:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1790096933.757347:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1790096933.791624:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790096933.791970:0:15121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790096933.792759:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790096933.792989:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790096933.793223:0:15121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790096933.793572:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:3.0:1790096933.793914:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:3.0:1790096933.794009:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:3.0:1790096933.794498:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1790096933.794770:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 342: rc = 0 00100000:10000000:3.0:1790096933.795053:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1790096933.795308:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1790096933.795757:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 342: rc = 0 00100000:10000000:3.0:1790096933.795989:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 342: rc = 0 00000020:00000080:3.0:1790096933.796576:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790096933.796588:0:15121:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790096933.796600:0:15121:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc97d9eae5ab69d7 00000020:01000004:3.0:1790096933.796608:0:15121:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790096933.796631:0:15121:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790096933.796784:0:15121:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790096933.796790:0:15121:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790096933.796795:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790096933.796807:0:15121:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eaaef5999c0) 00000020:00000080:3.0:1790096933.796817:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790096933.798068:0:15121:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096933.798233:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790096933.798239:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790096933.800494:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790096933.800506:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790096933.803226:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790096933.803237:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790096933.811703:0:15121:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096933.811893:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790096933.811899:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790096933.812892:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790096933.812901:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790096933.853987:0:15121:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096933.854738:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790096933.854746:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790096933.867692:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790096933.867886:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790096933.868757:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790096933.868765:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790096933.876257:0:15121:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790096933.876453:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790096933.876460:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790096933.877428:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790096933.877437:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790096933.959019:0:15121:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790096933.959223:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790096933.959230:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790096933.960295:0:15121:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790096933.960303:0:15121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790096933.960851:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790096933.960876:0:15121:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790096933.960883:0:15121:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790096933.980231:0:15121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790096933.980279:0:15121:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790096933.980284:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790096933.980285:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790096933.980287:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096933.980288:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096933.980290:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096933.980291:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096933.980292:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096933.980294:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096933.980295:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096933.980299:0:15121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790096933.980301:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096933.980303:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790096933.980304:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096933.980305:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096933.980306:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096933.980307:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096933.980308:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096933.980309:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096933.980310:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096933.980337:0:15121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790096933.980360:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324143872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790096933.980433:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096933.980561:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac12ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096933.981806:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324143872 00000100:00100000:1.0:1790096933.981816:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324143872 00000100:00100000:1.0:1790096933.981906:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790096933.981917:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:15121:x1877052324143872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790096933.981976:0:14429:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790096933.981980:0:14429:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790096933.981983:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790096933.997853:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:15121:x1877052324143872:12345-0@lo:253:mount.lustre.0 Request processed in 15930us (17412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096933.997867:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790096933.997968:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324143872:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790096933.997982:0:15121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790096933.997998:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096933.998000:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790096933.998001:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096933.998003:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096933.998004:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096933.998005:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096933.998006:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096933.998008:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096933.998009:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790096933.998026:0:15121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eaaff0eb000 from lustre-OST0000 10000000:01000000:0.0:1790096933.998050:0:15121:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790096933.998053:0:15121:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790096933.998059:0:15121:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eaafbcb19c0 local copy 00010000:00010000:0.0:1790096933.998069:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096933.998289:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096933.998323:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096933.998360:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaacaac76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096933.998479:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144000 00000100:00100000:3.0:1790096933.998485:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144000 00000100:00100000:3.0:1790096933.998523:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790096933.998530:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:15121:x1877052324144000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096933.998685:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+12:15121:x1877052324144000:12345-0@lo:501:mount.lustre.0 Request processed in 154us (360us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790096933.998691:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790096933.998915:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790096933.998929:0:15121:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790096933.999068:0:15121:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790096933.999074:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999095:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096933.999120:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eaaff0eb000 10000000:01000000:1.0:1790096933.999124:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790096933.999129:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eaafbcb19c0 10000000:01000000:1.0:1790096933.999131:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790096933.999135:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9eaafbcb19c0 from 1 10000000:01000000:1.0:1790096933.999138:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790096933.999160:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999168:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999178:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096933.999190:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790096933.999215:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096933.999242:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096933.999338:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144128 00000100:00100000:3.0:1790096933.999343:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144128 00000100:00100000:3.0:1790096933.999371:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790096933.999377:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+12:15121:x1877052324144128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790096933.999386:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096933.999397:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf6000/0xcc97d9eae5ab69ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab69e5 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096933.999415:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf6000/0xcc97d9eae5ab69ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69e5 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096933.999424:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf6000/0xcc97d9eae5ab69ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69e5 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096933.999432:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6000, rc 0) 00000100:00100000:3.0:1790096933.999472:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+13:15121:x1877052324144128:12345-0@lo:101:mount.lustre.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096933.999487:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790096933.999606:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096933.999617:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ec expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999625:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab69ec expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096933.999667:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790096933.999679:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ec expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999686:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148e200/0xcc97d9eae5ab69e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69ec expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096933.999692:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790096933.999695:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790096933.999698:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790096933.999700:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790096933.999713:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999719:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096933.999727:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096933.999737:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790096933.999757:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096933.999766:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096933.999813:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144256 00000100:00100000:0.0:1790096933.999817:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144256 00000100:00100000:0.0:1790096933.999844:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790096933.999850:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+13:15121:x1877052324144256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096933.999856:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096933.999864:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690400/0xcc97d9eae5ab69fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab69f3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096933.999877:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690400/0xcc97d9eae5ab69fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69f3 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096933.999885:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690400/0xcc97d9eae5ab69fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69f3 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096933.999901:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690400, rc 0) 00000100:00100000:0.0:1790096933.999926:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144256:12345-0@lo:101:mount.lustre.0 Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096933.999932:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790096934.000045:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096934.000055:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69fa expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.000063:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab69fa expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096934.001290:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790096934.004578:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096934.007295:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790096934.007391:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790096934.007427:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790096934.007488:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790096934.007528:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790096934.007564:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790096934.007674:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790096934.007684:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790096934.007785:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096934.007854:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.012679:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144384 00000100:00100000:3.0:1790096934.012694:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144384 00000100:00100000:3.0:1790096934.012755:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790096934.012764:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096934.013342:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144384:12345-0@lo:501:mount.lustre.0 Request processed in 577us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096934.013350:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790096934.025622:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790096934.025693:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096934.025763:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096934.025848:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096934.025893:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3180 going to sleep for 11 seconds 00000100:00100000:3.0:1790096934.027612:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144512 00000100:00100000:3.0:1790096934.027624:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144512 00000100:00100000:3.0:1790096934.027725:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790096934.027734:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790096934.028286:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144512:12345-0@lo:503:mount.lustre.0 Request processed in 551us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096934.028295:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790096934.032616:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790096934.033559:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790096934.033686:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096934.033753:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.033798:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.034324:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144640 00000100:00100000:0.0:1790096934.034332:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144640 00000100:00100000:0.0:1790096934.034381:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790096934.034389:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096934.034665:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144640:12345-0@lo:502:mount.lustre.0 Request processed in 276us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096934.034670:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096934.034673:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:3.0:1790096934.034937:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790096934.034995:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790096934.035027:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790096934.035073:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790096934.035121:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790096934.035157:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790096934.035218:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790096934.035256:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790096934.035287:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790096934.035335:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790096934.035372:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790096934.035413:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790096934.035442:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096934.035803:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.035911:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096934.036386:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144768 00000100:00100000:1.0:1790096934.036393:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144768 00000100:00100000:1.0:1790096934.036618:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790096934.036631:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096934.037332:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144768:12345-0@lo:502:mount.lustre.0 Request processed in 703us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.037341:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790096934.037681:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790096934.037789:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790096934.037804:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1790096934.043265:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790096934.043280:0:15136:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790096934.043286:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.043289:0:15136:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790096934.043295:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790096934.043313:0:15136:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eaaef598000) 00000020:00000080:3.0:1790096934.043335:0:15136:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790096934.043342:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790096934.043426:0:15136:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaaff0eb000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790096934.043435:0:15136:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790096934.043442:0:15136:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc97d9eae5ab6a08 00010000:00010000:3.0:1790096934.052397:0:15136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1790096934.053482:0:15136:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790096934.069399:0:15136:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1790096934.092797:0:15136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790096934.092814:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096934.092821:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.092824:0:15136:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790096934.092828:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790096934.092832:0:15136:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1790096934.092833:0:15136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790096934.092835:0:15136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790096934.092837:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790096934.092839:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.092841:0:15136:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790096934.092844:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096934.092847:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.092849:0:15136:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790096934.092867:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790096934.092869:0:15136:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790096934.092872:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096934.092874:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.092876:0:15136:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790096934.092878:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790096934.092894:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.092896:0:15136:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790096934.092901:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790096934.093100:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790096934.093105:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790096934.093106:0:15136:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790096934.093110:0:15136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790096934.093281:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790096934.093312:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790096934.093337:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69fa expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096934.093351:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f400/0xcc97d9eae5ab69f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab69fa expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096934.093371:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff0eb000 from 1 10000000:01000000:3.0:1790096934.093374:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790096934.093409:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096934.093417:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096934.093428:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096934.093454:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790096934.093524:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.093560:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.093628:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324144896 00000100:00100000:0.0:1790096934.093675:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324144896 00000100:00100000:0.0:1790096934.093717:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790096934.093726:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+14:15121:x1877052324144896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096934.093739:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096934.093750:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6a0f expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.093772:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.093783:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.093792:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690600, rc 0) 00000100:00100000:0.0:1790096934.093829:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324144896:12345-0@lo:101:mount.lustre.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096934.093837:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790096934.094415:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324144896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790096934.094432:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096934.094461:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790096934.097839:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790096934.098550:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790096934.098848:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790096934.102667:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790096934.102830:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790096934.102840:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790096934.104567:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096934.104768:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096934.104819:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790096934.104920:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145024 00000100:00100000:1.0:1790096934.104932:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145024 00000100:00100000:1.0:1790096934.104998:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790096934.105008:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096934.105278:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145024:12345-0@lo:501:mount.lustre.0 Request processed in 271us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.105286:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790096934.105525:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096934.105577:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790096934.105614:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096934.105655:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096934.107403:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145152 00000100:00100000:3.0:1790096934.107413:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145152 00000100:00100000:3.0:1790096934.107467:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790096934.107476:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790096934.107701:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145152:12345-0@lo:503:mount.lustre.0 Request processed in 226us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096934.107709:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790096934.108125:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790096934.108713:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790096934.108786:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790096934.108837:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096934.109439:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac30ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1790096934.115875:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145280 00000100:00100000:1.0:1790096934.116154:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145280 00000100:00100000:1.0:1790096934.116257:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790096934.116269:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096934.116556:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145280:12345-0@lo:502:mount.lustre.0 Request processed in 288us (7718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.116563:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790096934.116684:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790096934.117024:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790096934.117091:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790096934.117147:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790096934.117187:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790096934.117226:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790096934.117275:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790096934.117314:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790096934.117350:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790096934.117389:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096934.117436:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.123327:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac38619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096934.129072:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145408 00000100:00100000:2.0:1790096934.129098:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145408 00000100:00100000:2.0:1790096934.129156:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790096934.129166:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790096934.129451:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145408:12345-0@lo:502:mount.lustre.0 Request processed in 285us (12013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096934.129459:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790096934.129587:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790096934.129770:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790096934.129789:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790096934.135612:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096934.135626:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135628:0:15140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790096934.135680:0:15140:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaaff0eb000 00000020:00000080:3.0:1790096934.135683:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790096934.135698:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096934.135701:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135703:0:15140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790096934.135705:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096934.135708:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135709:0:15140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790096934.135712:0:15140:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaaff0eb000 00000020:00000080:3.0:1790096934.135714:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790096934.135762:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096934.135765:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135766:0:15140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790096934.135769:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096934.135771:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135772:0:15140:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790096934.135774:0:15140:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eaaff0eb000 00000020:00000080:3.0:1790096934.135776:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790096934.135808:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096934.135812:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096934.135813:0:15140:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790096934.135816:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1790096934.138926:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790096934.139188:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096934.139220:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.139233:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096934.139284:0:15121:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790096934.139287:0:15121:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eaaff0eb000 10000000:01000000:0.0:1790096934.139290:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eaaff0eb000 10000000:01000000:0.0:1790096934.139295:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790096934.139301:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaaff0eb000 from 1 10000000:01000000:0.0:1790096934.139304:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790096934.139339:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.139348:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.139359:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096934.139383:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790096934.139447:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.139485:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790096934.139545:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145536 00000100:00100000:2.0:1790096934.139551:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145536 00000100:00100000:2.0:1790096934.139600:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790096934.139608:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324145536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096934.139619:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096934.139630:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab6a24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6a1d expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096934.139685:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab6a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a1d expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096934.139695:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaae8db8600/0xcc97d9eae5ab6a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a1d expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096934.139703:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaae8db8600, rc 0) 00000100:00100000:2.0:1790096934.139738:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145536:12345-0@lo:101:mount.lustre.0 Request processed in 131us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096934.139743:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790096934.139828:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096934.139842:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a24 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.139861:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6a24 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096934.140583:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1790096934.144609:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790096934.144940:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790096934.145464:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790096934.145519:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790096934.145567:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790096934.145600:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790096934.145671:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790096934.145708:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790096934.145741:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790096934.145789:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790096934.145825:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790096934.145857:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790096934.145915:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790096934.146473:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790096934.146518:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790096934.146576:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790096934.146616:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790096934.146692:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790096934.146748:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790096934.146805:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790096934.146837:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790096934.146902:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790096934.146939:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790096934.149195:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790096934.149279:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790096934.149316:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1790096934.149347:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1790096934.149405:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1790096934.149441:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1790096934.149531:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1790096934.149539:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1790096934.149650:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096934.149712:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.149762:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145664 00000100:00100000:0.0:1790096934.149768:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145664 00000100:00100000:0.0:1790096934.149812:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790096934.149820:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096934.151248:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145664:12345-0@lo:501:mount.lustre.0 Request processed in 1423us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096934.151258:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790096934.151318:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.151343:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096934.151387:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790096934.151431:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.151463:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145792 00000100:00100000:0.0:1790096934.151469:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145792 00000100:00100000:0.0:1790096934.151502:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790096934.151510:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790096934.151667:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145792:12345-0@lo:503:mount.lustre.0 Request processed in 157us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096934.151673:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790096934.151711:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.151726:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790096934.156628:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790096934.156748:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096934.156828:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.156879:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324145920 00000100:00100000:0.0:1790096934.156887:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324145920 00000100:00100000:0.0:1790096934.156925:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096934.156934:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096934.157626:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324145920:12345-0@lo:502:mount.lustre.0 Request processed in 689us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096934.157670:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790096934.157726:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac11cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.157749:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324145920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790096934.165376:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790096934.165603:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790096934.165668:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790096934.165722:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790096934.165761:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790096934.165811:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790096934.165848:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790096934.165882:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790096934.165931:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790096934.165969:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790096934.166003:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790096934.166053:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790096934.166103:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790096934.166275:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790096934.166371:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790096934.166409:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790096934.166442:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790096934.166525:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790096934.166562:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790096934.166594:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790096934.166655:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790096934.166693:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790096934.166726:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790096934.166773:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790096934.166808:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790096934.166843:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790096934.166892:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790096934.166928:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790096934.166961:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790096934.167007:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790096934.167041:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790096934.167072:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790096934.167345:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790096934.167409:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790096934.167437:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790096934.167929:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790096934.167972:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790096934.168008:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790096934.168065:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790096934.168188:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790096934.168237:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324146048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096934.168385:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.168437:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac4299b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.171234:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146048 00000100:00100000:0.0:1790096934.171248:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146048 00000100:00100000:0.0:1790096934.171301:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790096934.171311:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324146048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096934.171606:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324146048:12345-0@lo:502:mount.lustre.0 Request processed in 295us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096934.171614:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790096934.171711:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324146048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790096934.171818:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790096934.171840:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790096934.174998:0:15145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790096934.175027:0:15145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eaace9619c0) 00000020:00000080:3.0:1790096934.175049:0:15145:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790096934.175138:0:15145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaaff0eb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790096934.175142:0:15145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaaff0eb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790096934.175145:0:15145:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaaff0eb000 3 00010000:00080000:3.0:1790096934.175176:0:15145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaac3018000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790096934.188328:0:15145:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1790096934.190043:0:15145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790096934.190119:0:15145:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790096934.190133:0:15145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcc97d9eae5ab6a32 00000100:00080000:3.0:1790096934.190144:0:15145:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790096934.190156:0:15145:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eaac3018000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096934.190192:0:15145:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b79c00 x1877052324146176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096934.190233:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324146176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790096934.190300:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096934.190361:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146176 00000100:00100000:3.0:1790096934.190368:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146176 00000100:00100000:3.0:1790096934.190396:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790096934.190403:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1877052324146176:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790096934.190426:0:14437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1790096934.191272:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc97d9eae5ab6a39 00000004:00100000:3.0:1790096934.191290:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790096934.191341:0:14437:0:(import.c:65:import_set_state_nolock()) ffff9eaaed5db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790096934.191408:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877052324146176:12345-0@lo:38:llog_process_th.0 Request processed in 1004us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096934.191426:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790096934.191489:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaaf3b79c00 x1877052324146176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096934.191501:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790096934.191509:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1790096934.191517:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790096934.191521:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790096934.191524:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaac3018000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790096934.191530:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1877052324146176:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790096934.191550:0:15145:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790096934.191710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790096934.191715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790096934.191717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790096934.191721:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790096934.191895:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324146304:0@lo:400:kworker.0 00000100:00100000:3.0:1790096934.191927:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096934.192779:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146304 00000100:00100000:2.0:1790096934.192788:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146304 00000100:00100000:2.0:1790096934.192837:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096934.192846:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096934.193327:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324146304:12345-0@lo:400:kworker.0 Request processed in 481us (1397us total) trans 0 rc 0/0 00010000:00080000:3.0:1790096934.193421:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eaafb3e8e00 x1877052324146304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096934.193434:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324146304:0@lo:400:kworker.0 00000100:00100000:2.0:1790096934.193530:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1790096934.199477:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790096934.199749:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790096934.199787:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790096934.199802:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a24 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.199813:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691600/0xcc97d9eae5ab6a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a24 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790096934.199856:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790096934.199859:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790096934.199860:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096934.199862:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096934.199863:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096934.199864:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096934.199866:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096934.199867:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096934.199868:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790096934.199872:0:15121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790096934.199875:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790096934.199876:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790096934.199877:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096934.199878:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096934.199879:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096934.199880:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096934.199881:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096934.199882:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096934.199894:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790096934.199920:0:15121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790096934.199939:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324146432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790096934.200127:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.200165:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac7eaa840 going to sleep for 11 seconds 00000100:00100000:0.0:1790096934.200189:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146432 00000100:00100000:0.0:1790096934.200197:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146432 00000100:00100000:0.0:1790096934.200235:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790096934.200243:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:15121:x1877052324146432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790096934.200287:0:14429:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790096934.200300:0:14429:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790096934.229487:0:14429:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790096934.229570:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790096934.229625:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790096934.229631:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790096934.229685:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.229704:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.229711:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.229749:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096934.229762:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 16 pid: 14430 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096934.229776:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324146560:0@lo:104: 00000100:00100000:0.0:1790096934.229839:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096934.229882:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790096934.230111:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146560 00000100:00100000:1.0:1790096934.230119:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146560 00000100:00100000:1.0:1790096934.230169:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790096934.230180:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324146560:12345-0@lo:104: 00010000:00010000:1.0:1790096934.230194:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230247:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790096934.230253:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324146560:12345-0@lo:104: Request processed in 76us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.230259:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1790096934.230276:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096934.230282:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230305:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:1.0:1790096934.230309:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230317:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790096934.230324:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096934.230329:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790096934.230369:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230376:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790096934.230393:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230401:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaac148f600/0xcc97d9eae5ab69a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69ad expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230415:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096934.230417:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096934.230418:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096934.230435:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324146688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096934.230462:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096934.230616:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146688 00000100:00100000:1.0:1790096934.230621:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146688 00010000:00010000:1.0:1790096934.230657:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 17 pid: 14430 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096934.230686:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790096934.230692:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+17:3315:x1877052324146688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096934.230703:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790096934.230708:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 17 pid: 14430 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230718:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 17 pid: 14430 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230732:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230740:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790096934.230753:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001123770s 00010000:00010000:1.0:1790096934.230757:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230764:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230769:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230775:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230781:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096934.230791:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230799:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230808:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.230817:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790096934.230850:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+17:3315:x1877052324146688:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.230857:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790096934.231071:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324146688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096934.231113:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaaffcf7e00/0xcc97d9eae5ab69ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab69a6 expref: 16 pid: 14430 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096934.231124:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324146560:0@lo:104: 00010000:00010000:1.0:1790096934.231138:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.231147:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.231153:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096934.231158:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8691000/0xcc97d9eae5ab6a40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096934.254147:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+15:15121:x1877052324146432:12345-0@lo:253:mount.lustre.0 Request processed in 53894us (54010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096934.254163:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790096934.254260:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15121:1877052324146432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790096934.254277:0:15121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790096934.254280:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790096934.254282:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790096934.254284:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790096934.254285:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790096934.254286:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790096934.254287:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790096934.254289:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790096934.254304:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790096934.254305:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790096934.254330:0:15121:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790096934.259400:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096934.259623:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096934.259830:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096934.260091:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096934.260235:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096934.260396:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790096934.261256:0:15121:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1790096934.325986:0:15121:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790096934.325995:0:15121:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790096934.326026:0:15121:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790096934.326102:0:15121:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790096934.326120:0:15121:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790096934.326148:0:15121:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790096934.781242:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096935.805840:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790096936.124845:0:14435:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790096936.124854:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea9c3140800 from 7 10000000:01000000:3.0:1790096936.124860:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790096936.124910:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096936.124922:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096936.125074:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096936.125117:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324146816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790096936.125184:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096936.125268:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac4d7f840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096936.129818:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146816 00000100:00100000:1.0:1790096936.129832:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146816 00000100:00100000:1.0:1790096936.129890:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790096936.129900:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+15:14435:x1877052324146816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096936.129916:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096936.129944:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6a47 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096936.129971:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096936.129982:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096936.129992:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ec00, rc 0) 00000100:00100000:1.0:1790096936.130086:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:14435:x1877052324146816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096936.130093:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790096936.130255:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324146816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096936.130276:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096936.130294:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096936.130359:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324146944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790096936.130395:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096936.130429:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb4a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790096936.130474:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324146944 00000100:00100000:0.0:1790096936.130479:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324146944 00000100:00100000:0.0:1790096936.130513:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790096936.130521:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:14435:x1877052324146944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790096936.130535:0:14430:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790096936.130552:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790096936.130555:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790096936.130625:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:14435:x1877052324146944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096936.130654:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790096936.130740:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324146944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790096936.130792:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790096936.130799:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096936.130808:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096936.835667:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096937.853683:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096938.309458:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790096938.880166:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790096939.391280:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790096939.391287:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790096939.391290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790096939.391294:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790096939.391348:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324147200:0@lo:400:kworker.0 00000100:00100000:0.0:1790096939.391415:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096939.391470:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790096939.391477:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324147072:0@lo:400:kworker.0 00000100:00100000:0.0:1790096939.391522:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096939.391566:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147200 00000100:00100000:0.0:1790096939.391575:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147200 00000100:00100000:0.0:1790096939.391620:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096939.391629:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324147200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096939.391696:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324147200:12345-0@lo:400:kworker.0 Request processed in 68us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096939.391703:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096939.391726:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147072 00000100:00100000:0.0:1790096939.391730:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147072 00000100:00100000:0.0:1790096939.391756:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790096939.391762:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:3317:x1877052324147072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096939.391792:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:3317:x1877052324147072:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096939.391798:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790096939.391840:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324147072:0@lo:400:kworker.0 00010000:00080000:0.0:1790096939.391854:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafb3e8000 x1877052324147200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096939.391866:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324147200:0@lo:400:kworker.0 00000100:00100000:1.0:1790096939.394984:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324147328:0@lo:400:kworker.0 00000100:00100000:1.0:1790096939.395079:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096939.396209:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147328 00000100:00100000:2.0:1790096939.396220:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147328 00000100:00100000:2.0:1790096939.396279:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790096939.396290:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324147328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096939.396370:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324147328:12345-0@lo:400:kworker.0 Request processed in 83us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096939.396378:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790096939.396531:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaafb3e9880 x1877052324147328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096939.396545:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324147328:0@lo:400:kworker.0 00000100:00080000:0.0:1790096939.397119:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790096939.901078:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096940.924753:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790096941.286542:0:15490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790096941.373283:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790096926/real 1790096926] req@ffff9eaaf3b78e00 x1877052324142592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096941.373316:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eaaf3b78e00 x1877052324142592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096941 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096941.373327:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790096926/real 1790096926] req@ffff9eaaf3b7b480 x1877052324142720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096941.373350:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eaaf3b7b480 x1877052324142720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790096941 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790096941.373370:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaee992000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790096941.373394:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790096941.373398:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324142592:0@lo:8:kworker.0 00000100:00080000:0.0:1790096941.373404:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790096941.373409:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790096941.373412:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324142720:0@lo:8:kworker.0 00000100:00080000:2.0:1790096941.373612:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790096941.373617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790096941.373620:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaee992000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790096941.373625:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1790096941.373630:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790096941.373655:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eaaee992000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096941.373674:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaad57e4a80 x1877052324147584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790096941.373687:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790096941.373690:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790096941.373692:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790096941.373694:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1790096941.373697:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790096941.373701:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790096941.373713:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaad57e4700 x1877052324147712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790096941.373754:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096941.373765:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cee436cd-c034-4d15-b596-e9f7d5252125:3314:1877052324147456:0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.373832:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.373885:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324147840:0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.373912:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.373934:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096941.373940:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324147968:0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.374045:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.374084:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147456 00000100:00100000:2.0:1790096941.374092:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147456 00000100:00100000:2.0:1790096941.374134:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790096941.374143:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:3314:x1877052324147456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.374193:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:3314:x1877052324147456:12345-0@lo:400:kworker.0 Request processed in 50us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096941.374200:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790096941.374230:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147840 00000100:00100000:2.0:1790096941.374234:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147840 00000100:00100000:2.0:1790096941.374259:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147968 00000100:00100000:2.0:1790096941.374261:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147968 00000100:00100000:2.0:1790096941.374586:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096941.374593:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324147840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.374652:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324147840:12345-0@lo:400:kworker.0 Request processed in 40us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096941.374659:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790096941.374671:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096941.374677:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324147968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.374704:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324147968:12345-0@lo:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096941.374710:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096941.374747:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cee436cd-c034-4d15-b596-e9f7d5252125:3314:1877052324147456:0@lo:400:kworker.0 00000100:00080000:2.0:1790096941.374768:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790096941.374784:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad57e4380 x1877052324147968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096941.374794:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324147968:0@lo:400:kworker.0 00010000:00080000:2.0:1790096941.374814:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad57e6300 x1877052324147840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096941.374821:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324147840:0@lo:400:kworker.0 00000100:00100000:2.0:1790096941.374841:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324147584:0@lo:8:kworker.0 00000100:00100000:2.0:1790096941.374871:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.374888:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324147712:0@lo:8:kworker.0 00000100:00100000:2.0:1790096941.374908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.374946:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147584 00000100:00100000:2.0:1790096941.374950:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147584 00000100:00100000:2.0:1790096941.374977:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324147712 00000100:00100000:2.0:1790096941.374981:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324147712 00000100:00100000:2.0:1790096941.374992:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096941.374997:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324147584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790096941.375020:0:15122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1790096941.375057:0:15122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab6a55 00002000:00100000:2.0:1790096941.375071:0:15122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eaaeb6df800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790096941.375076:0:15122:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790096941.375078:0:15122:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790096941.379582:0:15122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790096941.379620:0:15122:0:(import.c:65:import_set_state_nolock()) ffff9eaaeb6de800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096941.379737:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1877052324147584:12345-0@lo:8:kworker.0 Request processed in 4737us (4862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096941.379748:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096941.379777:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096941.379784:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324147712:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790096941.379814:0:15122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790096941.379844:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324147712:12345-0@lo:8:kworker.0 Request processed in 60us (4935us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790096941.379851:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790096941.380620:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad57e4a80 x1877052324147584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790096961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096941.380661:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790096941.380671:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790096941.380679:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790096941.380685:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790096941.380688:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaee992000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790096941.380715:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790096941.380722:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324147584:0@lo:8:kworker.0 00000100:00080000:1.0:1790096941.380738:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790096941.380742:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790096941.380745:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324147712:0@lo:8:kworker.0 00000004:00080000:0.0:1790096941.380881:0:14459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790096941.381348:0:14459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470951712199ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790096941.385869:0:14460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790096941.385904:0:14460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1877052324148224:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790096941.385980:0:14460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.386036:0:14460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6a14840 going to sleep for 11 seconds 00000100:00100000:2.0:1790096941.386068:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148224 00000100:00100000:2.0:1790096941.386076:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148224 00000100:00100000:2.0:1790096941.386134:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096941.386143:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1877052324148224:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790096941.386274:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096941.386286:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324148096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096941.386321:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096941.387466:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148096 00000100:00100000:0.0:1790096941.387476:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148096 00000100:00100000:0.0:1790096941.387516:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790096941.387526:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324148096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790096941.387557:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096941.387623:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877052324148096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096941.387630:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790096941.387900:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaad57e5f80 x1877052324148096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096941.387922:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324148096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790096941.395501:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1790096941.404535:0:15124:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790096941.404547:0:15124:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1790096941.404552:0:15124:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1790096941.429989:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.430004:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430021:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1790096941.430035:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.430042:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430060:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430082:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430090:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430110:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790096941.430125:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096941.430131:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430138:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096941.430142:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430151:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430167:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430174:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430191:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.430200:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.430202:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.430696:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.430703:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430713:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1790096941.430716:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.430720:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430729:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430737:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430745:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430760:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790096941.430769:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096941.430774:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430781:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096941.430784:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430810:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430822:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430829:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.430841:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.430842:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.430844:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790096941.434187:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1790096941.434719:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.434729:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.434746:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.434751:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.434757:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.434772:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.434783:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.434799:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.434818:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096941.435000:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.435008:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.435017:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.435021:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.435045:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.435066:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.435074:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42a7d67/0xcc97d9eae5ab6a6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.435092:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.435099:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.435101:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.435521:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.435527:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.435536:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.435540:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.435544:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.435555:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.435563:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.435570:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.435592:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096941.437800:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.437813:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.437827:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.437831:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.437842:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.437861:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.437868:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe309e1/0xcc97d9eae5ab6a71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.437891:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.437893:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.437905:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.438321:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.438329:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438346:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.438350:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.438355:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438367:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438375:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438382:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438406:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096941.438884:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.438890:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438909:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.438911:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.438915:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438924:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438941:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.438947:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.444858:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790096941.445293:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096941.445303:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445316:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.445321:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445341:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445362:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445371:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c4dccf/0xcc97d9eae5ab6a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445396:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.445400:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445407:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.445410:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445417:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445427:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445433:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abed867e/0xcc97d9eae5ab6a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790096941.445455:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790096941.445457:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.445460:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.445463:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.445466:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445480:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.445485:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.445491:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445505:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445514:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445521:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445555:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096941.445681:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.445688:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445696:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.445700:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445707:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445720:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445727:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3770c4/0xcc97d9eae5ab6a86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.445745:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.445748:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.445750:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.445980:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.445986:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.445994:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.445997:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.446000:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446009:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446017:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446036:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446056:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096941.446435:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.446441:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446449:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.446458:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.446463:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446472:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446480:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446487:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446495:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790096941.446711:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096941.446718:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446740:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.446743:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446752:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446766:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446773:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a52c74f/0xcc97d9eae5ab6a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446792:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.446795:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446802:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.446804:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446811:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446821:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446834:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b51f68/0xcc97d9eae5ab6a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.446852:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.446854:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.446856:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.446928:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.446934:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446941:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.446944:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.446948:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446957:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446965:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.446978:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447001:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096941.447040:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.447046:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.447054:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.447057:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.447065:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.447077:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.447085:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dea2f82b/0xcc97d9eae5ab6a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.447100:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.447103:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.447104:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.447415:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.447421:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447430:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.447433:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.447437:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447446:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447453:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447459:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447481:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096941.447913:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.447919:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447933:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.447936:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.447940:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447951:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447959:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447966:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.447974:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790096941.448536:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.448543:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.448551:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.448554:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.448558:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.448568:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.448588:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.448595:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.448604:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790096941.449095:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.449102:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449111:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.449115:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.449119:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449129:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449138:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449146:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449167:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1790096941.449672:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00010000:2.0:1790096941.449674:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790096941.449681:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449683:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449705:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096941.449707:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790096941.449712:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449713:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.449722:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449727:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449737:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449748:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449749:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449768:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449769:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df2cd688/0xcc97d9eae5ab6aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.449793:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1790096941.449801:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790096941.449807:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449814:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.449817:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449825:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449848:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449854:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064b54d9b/0xcc97d9eae5ab6aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449874:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790096941.449878:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449884:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db9a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.449888:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449896:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449906:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449914:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea1fe61/0xcc97d9eae5ab6ab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449929:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096941.449933:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449945:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaae8db8200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.449949:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449956:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449968:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449975:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d88d92/0xcc97d9eae5ab6ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.449991:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.449995:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.450001:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.450004:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.450012:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.450037:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.450051:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b561edd/0xcc97d9eae5ab6abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.450066:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.450067:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.450069:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.450237:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.450243:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450252:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.450262:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.450267:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450276:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450285:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450293:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450318:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096941.450781:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.450788:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450796:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.450799:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.450804:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450814:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450822:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450837:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.450846:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790096941.451294:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.451301:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451310:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.451314:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.451318:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451328:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451336:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451344:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451353:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790096941.451853:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.451859:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451872:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.451875:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.451879:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451888:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451896:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451902:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.451909:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1790096941.452118:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790096941.452126:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452136:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096941.452139:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452156:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452175:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452182:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd813eb1/0xcc97d9eae5ab6ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452204:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790096941.452208:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452215:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096941.452218:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452226:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452236:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452243:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452271:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096941.452275:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452283:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096941.452286:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452294:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452305:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452312:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452325:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1790096941.452329:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096941.452329:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452342:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452343:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096941.452349:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452357:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.452362:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.452370:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452378:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452383:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452391:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452405:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452420:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452426:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.452429:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452430:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096941.452433:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096941.452459:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096941.452464:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096941.452469:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452476:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096941.452480:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452487:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452496:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452515:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa7af5ac/0xcc97d9eae5ab6ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096941.452533:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096941.452536:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096941.452538:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096941.452886:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.452892:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452901:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.452904:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.452908:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452917:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452924:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452931:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.452957:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096941.453361:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.453367:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453375:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.453378:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.453382:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453391:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453400:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453407:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453415:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790096941.453832:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.453839:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453848:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.453859:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.453864:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453874:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453883:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453890:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.453899:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790096941.454355:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.454361:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454370:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.454373:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.454378:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454389:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454397:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454413:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454421:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790096941.454841:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.454847:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454856:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.454860:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.454864:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454874:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454882:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454890:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.454898:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790096941.455308:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.455315:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455330:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.455333:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.455339:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455348:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455357:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455364:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455372:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1790096941.455772:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096941.455778:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455786:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1790096941.455789:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096941.455794:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455803:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455822:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455829:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096941.455837:0:15124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:2.0:1790096941.456005:0:15124:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1790096941.456116:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1877052324148224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69970us (70133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096941.456126:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096941.456183:0:14460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1877052324148224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790096941.456198:0:14460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790096941.456241:0:14460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1877052324148352:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790096941.456273:0:14460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096941.456306:0:14460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2fabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096941.456324:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148352 00000100:00100000:2.0:1790096941.456330:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148352 00000100:00100000:2.0:1790096941.456371:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096941.456380:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14460:x1877052324148352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790096941.456414:0:15122:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1790096941.456869:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1790096941.456879:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456889:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.456904:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456916:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456936:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456943:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf61e900/0xcc97d9eae5ab6ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456976:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1790096941.456981:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.456994:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.456998:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457007:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457019:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457035:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c237b3/0xcc97d9eae5ab6aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457053:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790096941.457056:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457062:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.457065:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457071:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457080:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457093:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b5170fc/0xcc97d9eae5ab6af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457104:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790096941.457107:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457115:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.457118:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457127:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457139:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457147:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051c71539/0xcc97d9eae5ab6afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457165:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790096941.457168:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457175:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.457185:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457194:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457206:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457214:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c78b460/0xcc97d9eae5ab6b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457230:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096941.457234:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457240:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.457243:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457250:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457259:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457266:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c48d83/0xcc97d9eae5ab6b0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457286:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096941.457290:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457295:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096941.457299:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457307:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457318:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457325:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ed0070/0xcc97d9eae5ab6b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096941.457344:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.457347:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096941.457349:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096941.460334:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14460:x1877052324148352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3949us (4053us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790096941.460346:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790096941.460451:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096941.461115:0:14460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1877052324148352:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790096941.461131:0:14460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1790096941.950897:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096942.975214:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096943.996832:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790096944.669918:0:6721:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1790096944.669981:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790096945.021387:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096946.047730:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790096946.559332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096946.559345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790096946.559349:0:36:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790096946.559356:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1790096946.559362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790096946.559373:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096946.559396:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b7a680 x1877052324148736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790096946.559449:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324148480:0@lo:400:kworker.0 00000100:00100000:3.0:1790096946.559531:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096946.559579:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096946.559585:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324148992:0@lo:400:kworker.0 00000100:00100000:3.0:1790096946.559610:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096946.559658:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324148736:0@lo:8:kworker.0 00000100:00100000:3.0:1790096946.559684:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096946.559721:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148736 00000100:00100000:3.0:1790096946.559729:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148736 00000100:00100000:3.0:1790096946.559758:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790096946.559765:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1877052324148736:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790096946.559782:0:15125:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790096946.561209:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324148608:0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.561257:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096946.561308:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096946.561316:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324148864:0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.561343:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096946.561368:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148480 00000100:00100000:0.0:1790096946.561374:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148480 00000100:00100000:2.0:1790096946.561380:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148992 00000100:00100000:2.0:1790096946.561386:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148992 00000100:00100000:2.0:1790096946.561433:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148864 00000100:00100000:2.0:1790096946.561436:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148864 00000100:00100000:2.0:1790096946.561468:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096946.561478:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324148992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.561530:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877052324148992:12345-0@lo:400:kworker.0 Request processed in 55us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096946.561537:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790096946.561541:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096946.561549:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:3315:x1877052324148480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.561563:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790096946.561571:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096946.561609:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:3315:x1877052324148480:12345-0@lo:400:kworker.0 Request processed in 61us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096946.561619:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790096946.561621:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877052324148864:12345-0@lo:400:kworker.0 Request processed in 47us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096946.561630:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790096946.561694:0:15122:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790096946.561702:0:15122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1790096946.561736:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790096946.561769:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79f80 x1877052324148864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096946.562532:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877052324148864:0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.563025:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790096946.563041:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096946.563098:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096946.563122:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149120 00000100:00100000:0.0:1790096946.563130:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149120 00000100:00100000:2.0:1790096946.563144:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324148608 00000100:00100000:2.0:1790096946.563149:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324148608 00000100:00100000:2.0:1790096946.563184:0:15122:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790096946.563187:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096946.563196:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096946.563205:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1877052324148608:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790096946.563239:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096946.563262:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1877052324148608:12345-0@lo:400:kworker.0 Request processed in 53us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096946.563262:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324149120:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096946.563275:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00000024:0.0:1790096946.563295:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096946.563336:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324149120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096946.563343:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096946.563376:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790096946.563395:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096946.563425:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324148608:0@lo:400:kworker.0 00010000:00080000:2.0:1790096946.563469:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79880 x1877052324148992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096946.563480:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1877052324148992:0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.563491:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324148480:0@lo:400:kworker.0 00000100:00100000:2.0:1790096946.575286:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1877052324148736:12345-0@lo:8:kworker.0 Request processed in 15515us (15596us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790096946.575299:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790096946.575380:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790096946.575387:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790096946.575391:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324148736:0@lo:8:kworker.0 00010000:00010000:3.0:1790096947.069513:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096948.099904:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096948.546845:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790096949.122897:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790096949.505933:0:15842:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790096949.505937:0:15842:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790096949.506141:0:15842:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eaac3de7000 00000020:01000004:0.0:1790096949.506158:0:15842:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790096949.506171:0:15842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790096949.506243:0:15842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eaac97d19c0) 00000020:00000080:0.0:1790096949.506261:0:15842:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790096949.535300:0:15842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790096949.535599:0:15842:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790096949.539536:0:15842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790096949.539835:0:15842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790096949.541604:0:15842:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790096949.543552:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 333: rc = 0 00100000:10000000:3.0:1790096949.543944:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 333: rc = 0 00100000:10000000:3.0:1790096949.544137:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 333: rc = 0 00100000:10000000:3.0:1790096949.545336:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1790096949.545815:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1790096949.546612:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1790096949.547211:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1790096949.547611:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1790096949.548110:0:15842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:3.0:1790096949.549087:0:15842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790096949.549100:0:15842:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790096949.549113:0:15842:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc97d9eae5ab6b20 00000020:01000004:3.0:1790096949.549121:0:15842:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790096949.549142:0:15842:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790096949.549145:0:15842:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790096949.549152:0:15842:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790096949.549174:0:15842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790096949.549177:0:15842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790096949.559523:0:15842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790096949.559565:0:15842:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790096949.559570:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790096949.559572:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.559573:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.559574:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.559576:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.559577:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.559578:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.559580:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.559581:0:15842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096949.559586:0:15842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790096949.559591:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096949.559593:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.559594:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.559594:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.559595:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.559596:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.559597:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.559598:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.559599:0:15842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790096949.559624:0:15842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790096949.559805:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790096949.559942:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.560060:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1790096949.560103:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149248 00000100:00100000:2.0:1790096949.560111:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149248 00000100:00100000:2.0:1790096949.560195:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790096949.560205:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15842:x1877052324149248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790096949.560245:0:14430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790096949.560248:0:14430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790096949.560252:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790096949.565990:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15842:x1877052324149248:12345-0@lo:253:mount.lustre.0 Request processed in 5777us (6039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.566005:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790096949.566105:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790096949.566119:0:15842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790096949.566123:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790096949.566124:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.566125:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.566126:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.566128:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.566130:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.566131:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.566133:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.566135:0:15842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790096949.566156:0:15842:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eaac3de7000 from lustre-OST0001 10000000:01000000:3.0:1790096949.566183:0:15842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790096949.566186:0:15842:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790096949.566193:0:15842:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eaafbcb19c0 local copy 00010000:00010000:3.0:1790096949.566204:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096949.566437:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096949.566474:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.566550:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1790096949.566601:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149376 00000100:00100000:0.0:1790096949.566607:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149376 00000100:00100000:0.0:1790096949.566719:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790096949.566728:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:15842:x1877052324149376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096949.567038:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+16:15842:x1877052324149376:12345-0@lo:501:mount.lustre.0 Request processed in 310us (563us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790096949.567045:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790096949.567189:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149376:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790096949.567206:0:15842:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790096949.567350:0:15842:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790096949.567358:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.567369:0:15842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac8691e00/0xcc97d9eae5ab68cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab68d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096949.567393:0:15842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eaac3de7000 10000000:01000000:3.0:1790096949.567398:0:15842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790096949.567403:0:15842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790096949.567405:0:15842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790096949.567409:0:15842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790096949.567412:0:15842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790096949.567437:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.567446:0:15842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.567456:0:15842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096949.567470:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790096949.567500:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.567534:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaf3eb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790096949.567593:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149504 00000100:00100000:2.0:1790096949.567598:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149504 00000100:00100000:2.0:1790096949.567648:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790096949.567657:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+16:15842:x1877052324149504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096949.567666:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096949.567678:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaace841e00/0xcc97d9eae5ab6b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6b27 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.567769:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaace841e00/0xcc97d9eae5ab6b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b27 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.567781:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaace841e00/0xcc97d9eae5ab6b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b27 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.567790:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace841e00, rc 0) 00000100:00100000:1.0:1790096949.567942:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790096949.567955:0:15842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b2e expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.567995:0:15842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6b2e expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096949.568580:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:2.0:1790096949.568927:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149504:12345-0@lo:101:mount.lustre.0 Request processed in 179us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.568936:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000040:00080000:1.0:1790096949.570068:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096949.570337:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790096949.570383:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790096949.570416:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790096949.570462:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790096949.570498:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790096949.570531:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790096949.570594:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790096949.570602:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790096949.570805:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096949.570945:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.571047:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29540 going to sleep for 11 seconds 00000100:00100000:2.0:1790096949.571093:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149632 00000100:00100000:2.0:1790096949.571101:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149632 00000100:00100000:2.0:1790096949.571199:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790096949.571209:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096949.571587:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149632:12345-0@lo:501:mount.lustre.0 Request processed in 379us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.571594:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790096949.571718:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790096949.571753:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096949.571792:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.572099:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29540 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.572190:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149760 00000100:00100000:3.0:1790096949.572195:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149760 00000100:00100000:3.0:1790096949.572228:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790096949.572234:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790096949.572516:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149760:12345-0@lo:503:mount.lustre.0 Request processed in 281us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.572524:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790096949.572609:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790096949.573440:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790096949.573505:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.573555:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.573706:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29540 going to sleep for 11 seconds 00000100:00100000:2.0:1790096949.573909:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324149888 00000100:00100000:2.0:1790096949.573916:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324149888 00000100:00100000:3.0:1790096949.574007:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790096949.574017:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096949.574209:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324149888:12345-0@lo:502:mount.lustre.0 Request processed in 194us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.574217:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790096949.574333:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324149888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790096949.574570:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790096949.574628:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790096949.574717:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790096949.574767:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790096949.574807:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790096949.575039:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1790096949.575096:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1790096949.575133:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1790096949.575184:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1790096949.575220:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.575266:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.575305:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29540 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.575363:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150016 00000100:00100000:3.0:1790096949.575369:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150016 00000100:00100000:3.0:1790096949.575395:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790096949.575401:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324150016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790096949.575558:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324150016:12345-0@lo:502:mount.lustre.0 Request processed in 156us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.575565:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790096949.577517:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790096949.577803:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790096949.577819:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1790096949.579961:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790096949.579979:0:15843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1790096949.579986:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.579989:0:15843:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790096949.579996:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790096949.580013:0:15843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eaace963380) 00000020:00000080:3.0:1790096949.580038:0:15843:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790096949.580045:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790096949.580125:0:15843:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaac3de7000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790096949.580134:0:15843:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790096949.580142:0:15843:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc97d9eae5ab6b3c 00010000:00010000:3.0:1790096949.584134:0:15843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1790096949.584527:0:15843:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1790096949.586902:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790096949.592486:0:15843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790096949.592501:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096949.592508:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.592511:0:15843:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790096949.592514:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096949.592519:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.592521:0:15843:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790096949.592525:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790096949.592527:0:15843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790096949.592530:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096949.592532:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.592533:0:15843:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790096949.592535:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790096949.592537:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.592538:0:15843:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790096949.592542:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790096949.592611:0:15843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790096949.592614:0:15843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790096949.592616:0:15843:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790096949.592619:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790096949.592780:0:15842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790096949.592810:0:15842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790096949.592829:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b2e expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.592850:0:15842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7800/0xcc97d9eae5ab6b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b2e expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096949.592859:0:15842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac3de7000 from 1 10000000:01000000:2.0:1790096949.592862:0:15842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790096949.592898:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.592906:0:15842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.592919:0:15842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096949.592945:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790096949.593025:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.593070:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac59f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790096949.593293:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150144 00000100:00100000:0.0:1790096949.593301:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150144 00000100:00100000:0.0:1790096949.593352:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790096949.593362:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+17:15842:x1877052324150144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790096949.593376:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096949.593389:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6b43 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.593413:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.593444:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.593453:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8691800, rc 0) 00000100:00100000:0.0:1790096949.593541:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150144:12345-0@lo:101:mount.lustre.0 Request processed in 180us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.593548:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790096949.596192:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790096949.596226:0:15842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.596239:0:15842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790096949.597110:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790096949.597398:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790096949.597624:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790096949.598959:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790096949.599069:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790096949.599079:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790096949.603335:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096949.603408:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.603468:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790096949.606789:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150272 00000100:00100000:0.0:1790096949.606807:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150272 00000100:00100000:0.0:1790096949.606882:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790096949.606893:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790096949.607232:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150272:12345-0@lo:501:mount.lustre.0 Request processed in 339us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.607241:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790096949.607922:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096949.607987:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790096949.608037:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.608069:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790096949.608142:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150400 00000100:00100000:0.0:1790096949.608148:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150400 00000100:00100000:0.0:1790096949.608281:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790096949.608289:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790096949.608659:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150400:12345-0@lo:503:mount.lustre.0 Request processed in 369us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.608668:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790096949.609065:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790096949.609662:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790096949.609907:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.609982:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.610087:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150528 00000100:00100000:3.0:1790096949.610093:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150528 00000100:00100000:3.0:1790096949.610125:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790096949.610133:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.610411:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29900 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.610683:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150528:12345-0@lo:502:mount.lustre.0 Request processed in 550us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.610695:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790096949.610786:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790096949.611014:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790096949.611058:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790096949.611096:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790096949.611127:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790096949.611155:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790096949.612286:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790096949.612333:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790096949.612366:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790096949.612403:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.613065:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.613139:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29900 going to sleep for 11 seconds 00000100:00100000:0.0:1790096949.613176:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150656 00000100:00100000:0.0:1790096949.613252:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150656 00000100:00100000:0.0:1790096949.613342:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790096949.613351:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790096949.613562:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150656:12345-0@lo:502:mount.lustre.0 Request processed in 213us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.613571:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790096949.613675:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790096949.613797:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790096949.613809:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790096949.614772:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096949.614783:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.614786:0:15847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790096949.614794:0:15847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac3de7000 00000020:00000080:1.0:1790096949.614796:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790096949.614803:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096949.614806:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.614807:0:15847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790096949.614809:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096949.614812:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.614813:0:15847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790096949.614817:0:15847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eaac3de7000 00000020:00000080:1.0:1790096949.614819:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790096949.614983:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096949.614988:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.614990:0:15847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790096949.614993:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790096949.614996:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.614997:0:15847:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790096949.615001:0:15847:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eaac3de7000 00000020:00000080:1.0:1790096949.615003:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790096949.615040:0:15847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790096949.615044:0:15847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790096949.615045:0:15847:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790096949.615049:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790096949.615172:0:15842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790096949.615216:0:15842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790096949.615241:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.615253:0:15842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790096949.615309:0:15842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790096949.615313:0:15842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eaac3de7000 10000000:01000000:2.0:1790096949.615316:0:15842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eaac3de7000 10000000:01000000:2.0:1790096949.615319:0:15842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790096949.615325:0:15842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eaac3de7000 from 1 10000000:01000000:2.0:1790096949.615328:0:15842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790096949.615361:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.615368:0:15842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.615378:0:15842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096949.615403:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790096949.615463:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.615877:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.617860:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150784 00000100:00100000:3.0:1790096949.617872:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150784 00000100:00100000:3.0:1790096949.617922:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790096949.617931:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324150784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790096949.617946:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096949.617973:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6b51 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.618001:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b51 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.618021:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf7a00/0xcc97d9eae5ab6b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b51 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.618030:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7a00, rc 0) 00000100:00100000:3.0:1790096949.618108:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324150784:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.618114:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790096949.618345:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790096949.618364:0:15842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b58 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096949.618374:0:15842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6b58 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790096949.619151:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1790096949.623515:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790096949.624142:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790096949.625303:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790096949.625360:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790096949.625420:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790096949.625453:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790096949.625501:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790096949.625538:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790096949.625574:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790096949.625624:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790096949.625670:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790096949.627361:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790096949.627482:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790096949.627519:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790096949.627552:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790096949.627605:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790096949.627671:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790096949.627708:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790096949.627770:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790096949.627806:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790096949.627852:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790096949.627902:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790096949.627937:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790096949.627983:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790096949.628044:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790096949.628083:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790096949.628116:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790096949.628164:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790096949.628390:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790096949.628430:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790096949.628480:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1790096949.628518:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1790096949.628554:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1790096949.628583:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1790096949.628625:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1790096949.628749:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1790096949.628804:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1790096949.629265:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1790096949.629370:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1790096949.629378:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1790096949.629495:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096949.629559:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.629604:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.630388:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324150912 00000100:00100000:3.0:1790096949.630397:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324150912 00000100:00100000:3.0:1790096949.630438:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790096949.630446:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac790f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324150912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790096949.630725:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac790f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324150912:12345-0@lo:501:mount.lustre.0 Request processed in 279us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.630733:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790096949.633001:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324150912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790096949.633060:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790096949.633131:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.641393:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac78de300 going to sleep for 11 seconds 00000100:00100000:1.0:1790096949.642793:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151040 00000100:00100000:1.0:1790096949.642812:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151040 00000100:00100000:1.0:1790096949.643792:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790096949.643804:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790096949.644183:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151040:12345-0@lo:503:mount.lustre.0 Request processed in 382us (11052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096949.647171:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790096949.647312:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790096949.648002:0:15842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790096949.648084:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790096949.648156:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.648202:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad1a64840 going to sleep for 11 seconds 00000100:00100000:1.0:1790096949.648268:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151168 00000100:00100000:1.0:1790096949.648275:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151168 00000100:00100000:1.0:1790096949.648323:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790096949.648332:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.648702:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151168:12345-0@lo:502:mount.lustre.0 Request processed in 370us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096949.648710:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790096949.650249:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790096949.650527:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790096949.650582:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790096949.650617:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790096949.650821:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790096949.650938:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790096949.651001:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790096949.651038:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790096949.651073:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790096949.651120:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790096949.651152:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790096949.651180:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790096949.651297:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790096949.651333:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790096949.651366:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790096949.651413:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790096949.651448:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790096949.651481:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790096949.651529:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790096949.651566:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790096949.651599:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790096949.652119:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790096949.652163:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790096949.652263:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790096949.652316:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790096949.652361:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1790096949.652393:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1790096949.652442:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1790096949.652475:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1790096949.652508:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1790096949.652550:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1790096949.652597:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1790096949.652623:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1790096949.652782:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1790096949.652828:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1790096949.658435:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1790096949.658529:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1790096949.658566:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790096949.658603:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790096949.658670:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790096949.658710:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790096949.658765:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790096949.658845:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.658896:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac783b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096949.658935:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151296 00000100:00100000:2.0:1790096949.658943:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151296 00000100:00100000:2.0:1790096949.659009:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790096949.659019:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790096949.659260:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324151296:12345-0@lo:502:mount.lustre.0 Request processed in 243us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.659268:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790096949.660496:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324151296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790096949.660609:0:15842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790096949.660621:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790096949.668948:0:15852:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790096949.668977:0:15852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eaafc83b380) 00000020:00000080:1.0:1790096949.669069:0:15852:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790096949.669151:0:15852:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eaac3de7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790096949.669155:0:15852:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eaac3de7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790096949.669158:0:15852:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eaac3de7000 3 00010000:00080000:1.0:1790096949.669258:0:15852:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eaae6097800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790096949.673039:0:15852:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1790096949.673244:0:15852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790096949.673279:0:15852:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790096949.677145:0:15852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcc97d9eae5ab6b66 00000100:00080000:1.0:1790096949.677167:0:15852:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790096949.677666:0:15852:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eaae6097800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790096949.677707:0:15852:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaffe9b800 x1877052324151424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790096949.677733:0:15852:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790096949.677843:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324151424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790096949.677918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790096949.678015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096949.678019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790096949.678022:0:36:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790096949.678026:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:3.0:1790096949.678029:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790096949.678034:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096949.678047:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b78a80 x1877052324151680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790096949.678061:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151424 00000100:00100000:2.0:1790096949.678068:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151424 00000100:00100000:3.0:1790096949.678095:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324151680:0@lo:8:kworker.0 00000100:00100000:2.0:1790096949.678111:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096949.678117:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1877052324151424:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790096949.678127:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790096949.678142:0:14438:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1790096949.678179:0:14438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc97d9eae5ab6b6d 00000040:00080000:3.0:1790096949.678501:0:15852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1790096949.678585:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324151936:0@lo:400:kworker.0 00000020:01000000:3.0:1790096949.678604:0:15842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1790096949.678618:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1790096949.678627:0:15842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790096949.678655:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b58 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096949.678666:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00010000:3.0:1790096949.678667:0:15842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaace841600/0xcc97d9eae5ab6b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b58 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096949.678673:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000004:3.0:1790096949.678725:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790096949.678727:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.678728:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.678729:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.678731:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.678732:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.678733:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.678735:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.678737:0:15842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790096949.678741:0:15842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790096949.678743:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790096949.678745:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.678746:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.678747:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.678748:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.678750:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.678751:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.678752:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.678753:0:15842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790096949.678767:0:15842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790096949.678778:0:15842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324152064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790096949.678824:0:15842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.678849:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152064 00000100:00100000:3.0:1790096949.678854:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152064 00000100:00100000:3.0:1790096949.678892:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790096949.678899:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:15842:x1877052324152064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790096949.678922:0:14430:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790096949.678934:0:14430:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00100000:2.0:1790096949.678944:0:14438:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790096949.678987:0:14438:0:(import.c:65:import_set_state_nolock()) ffff9eaaeb6d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096949.679034:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877052324151424:12345-0@lo:38:llog_process_th.0 Request processed in 916us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.679043:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790096949.679057:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151936 00000100:00100000:2.0:1790096949.679060:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151936 00000100:00100000:2.0:1790096949.679089:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096949.679095:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324151936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096949.679129:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324151936:12345-0@lo:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.679136:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790096949.679163:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790096949.679434:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b7b480 x1877052324151936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096949.679460:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324151936:0@lo:400:kworker.0 00000100:00100000:2.0:1790096949.679488:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324151552:0@lo:400:kworker.0 00000100:00100000:2.0:1790096949.679518:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096949.679597:0:15842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac59f73c0 going to sleep for 11 seconds 00010000:00080000:0.0:1790096949.683888:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaffe9b800 x1877052324151424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790096959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096949.684024:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790096949.684038:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790096949.684048:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790096949.684054:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790096949.684058:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaae6097800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790096949.684066:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1877052324151424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790096949.690022:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151680 00000100:00100000:2.0:1790096949.690035:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151680 00000100:00100000:2.0:1790096949.690070:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151552 00000100:00100000:2.0:1790096949.690073:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151552 00000100:00100000:3.0:1790096949.690088:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790096949.690099:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324151680:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790096949.690112:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096949.690122:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324151552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096949.690212:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324151552:12345-0@lo:400:kworker.0 Request processed in 92us (10693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.690220:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790096949.690225:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1877052324151680:12345-0@lo:8:kworker.0 Request processed in 124us (12094us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790096949.690237:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790096949.690289:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324151808:0@lo:400:kworker.0 00000100:00080000:2.0:1790096949.690293:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096949.690340:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096949.690465:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324151808 00000100:00100000:2.0:1790096949.690469:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324151808 00000100:00100000:3.0:1790096949.690486:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790096949.690507:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790096949.690513:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790096949.690516:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790096949.690521:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324151680:0@lo:8:kworker.0 00000100:00100000:2.0:1790096949.690528:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096949.690575:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877052324151808:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096949.690582:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790096949.690614:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324151552:0@lo:400:kworker.0 00010000:00080000:0.0:1790096949.694100:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eaaf3b79f80 x1877052324151808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096949.694134:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877052324151808:0@lo:400:kworker.0 20000000:01000000:0.0:1790096949.730354:0:14430:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790096949.730366:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790096949.730628:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790096949.730650:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790096949.730672:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.730690:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.730699:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.730734:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.730748:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 19 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096949.730779:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324152192:0@lo:104: 00000100:00100000:1.0:1790096949.730843:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096949.730889:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaffea3240 going to sleep for 11 seconds 00000100:00100000:3.0:1790096949.731043:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152192 00000100:00100000:3.0:1790096949.731052:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152192 00000100:00100000:3.0:1790096949.731098:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790096949.731107:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324152192:12345-0@lo:104: 00010000:00010000:3.0:1790096949.731121:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731182:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790096949.731188:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cee436cd-c034-4d15-b596-e9f7d5252125+3:14453:x1877052324152192:12345-0@lo:104: Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096949.731195:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790096949.731221:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096949.731227:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731235:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:3.0:1790096949.731239:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731247:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790096949.731255:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790096949.731260:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790096949.731284:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731291:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790096949.731308:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1877052324152192:0@lo:104: 00010000:00010000:3.0:1790096949.731311:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731321:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf7200/0xcc97d9eae5ab6a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a4e expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.731332:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096949.731337:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096949.731340:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096949.731535:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096949.731549:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324152320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790096949.731578:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096949.732073:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152320 00000100:00100000:0.0:1790096949.732079:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152320 00010000:00010000:0.0:1790096949.732102:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 20 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096949.732129:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096949.732136:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+20:3315:x1877052324152320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096949.732147:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096949.732152:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 20 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732162:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 20 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732175:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148ec00/0xcc97d9eae5ab6a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a47 expref: 20 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732188:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732207:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790096949.732226:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001576362s 00010000:00010000:0.0:1790096949.732230:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732238:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732244:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732251:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732256:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096949.732259:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732267:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732284:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096949.732292:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096949.732332:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cee436cd-c034-4d15-b596-e9f7d5252125+19:3315:x1877052324152320:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096949.732338:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1790096949.733559:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.733573:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096949.733581:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148e400/0xcc97d9eae5ab6b74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096949.734839:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324152320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096949.754122:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+18:15842:x1877052324152064:12345-0@lo:253:mount.lustre.0 Request processed in 75216us (75289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096949.754137:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790096949.754331:0:15842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cee436cd-c034-4d15-b596-e9f7d5252125:15842:1877052324152064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790096949.754349:0:15842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790096949.754353:0:15842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790096949.754355:0:15842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790096949.754357:0:15842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790096949.754358:0:15842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790096949.754360:0:15842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790096949.754361:0:15842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790096949.754363:0:15842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790096949.754365:0:15842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790096949.754367:0:15842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790096949.754384:0:15842:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790096949.761188:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096949.761379:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096949.761837:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096949.762021:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790096949.762185:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790096949.762415:0:15842:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790096949.763951:0:15842:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790096949.864891:0:15842:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790096949.864901:0:15842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790096949.864933:0:15842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790096949.865011:0:15842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790096949.865029:0:15842:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790096949.865060:0:15842:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790096950.144970:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096951.166562:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096951.676819:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790096951.676844:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324152448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790096951.676917:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096951.677068:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152448 00000100:00100000:0.0:1790096951.677090:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152448 00000100:00100000:0.0:1790096951.677157:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790096951.677168:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324152448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790096951.677213:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096951.677261:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324152448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096951.677269:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790096951.677400:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096951.678393:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324152448:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1790096951.741687:0:14435:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790096951.741697:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea9c3140800 from 8 10000000:01000000:2.0:1790096951.741702:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790096951.741750:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096951.741763:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096951.741774:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096951.741818:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324152576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790096951.741896:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096951.741974:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaaeb4a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1790096951.743286:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152576 00000100:00100000:0.0:1790096951.743298:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152576 00000100:00100000:0.0:1790096951.743382:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790096951.743392:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324152576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096951.743408:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096951.743427:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac8690c00/0xcc97d9eae5ab6b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6b7b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096951.743453:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac8690c00/0xcc97d9eae5ab6b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b7b expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096951.743464:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac8690c00/0xcc97d9eae5ab6b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b7b expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096951.743474:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac8690c00, rc 0) 00000100:00100000:0.0:1790096951.743538:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324152576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096951.744000:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790096951.744067:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324152576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096951.744087:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b82 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096951.744114:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6b82 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096951.744667:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324152704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790096951.744729:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096951.745103:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac5ccfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096951.745687:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152704 00000100:00100000:2.0:1790096951.745696:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152704 00000100:00100000:2.0:1790096951.745745:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790096951.745754:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324152704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790096951.745784:0:14430:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790096951.745807:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790096951.745811:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790096951.745936:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324152704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096951.745944:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790096951.746254:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324152704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790096951.746336:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790096951.746347:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b82 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096951.746359:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaace841000/0xcc97d9eae5ab6b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6b82 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096952.190229:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096953.213713:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.237369:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096954.749028:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324152832:0@lo:400:kworker.0 00000100:00100000:1.0:1790096954.749107:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790096954.749207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790096954.749212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790096954.749215:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790096954.749229:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eaaef5a9000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790096954.749250:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eaaf3b7bb80 x1877052324153088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790096954.749352:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152832 00000100:00100000:0.0:1790096954.749360:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152832 00000100:00100000:0.0:1790096954.749409:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790096954.749418:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaef5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324152832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.749553:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324153216:0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.749588:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.749614:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790096954.749620:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324152960:0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.749678:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.749708:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324152960 00000100:00100000:2.0:1790096954.749713:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324152960 00000100:00100000:2.0:1790096954.749752:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790096954.749759:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324152960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.749817:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324152960:12345-0@lo:400:kworker.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096954.749825:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790096954.749844:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096954.749876:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324152960:0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.749906:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324153088:0@lo:8:kworker.0 00000100:00100000:2.0:1790096954.749943:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.749978:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153088 00000100:00100000:2.0:1790096954.749982:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153088 00000100:00100000:2.0:1790096954.750000:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096954.750004:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1877052324153088:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790096954.750028:0:15124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1790096954.750057:0:15124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc97d9eae5ab6b89 00002000:00100000:2.0:1790096954.750070:0:15124:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eaaeb6de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790096954.750074:0:15124:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790096954.750076:0:15124:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790096954.750400:0:15124:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790096954.750423:0:15124:0:(import.c:65:import_set_state_nolock()) ffff9eaaeb6da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096954.750464:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877052324153088:12345-0@lo:8:kworker.0 Request processed in 458us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096954.750470:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790096954.750501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7bb80 x1877052324153088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790096979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790096954.750514:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790096954.750521:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790096954.750525:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790096954.750527:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9eaaef5a9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790096954.750541:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790096954.750546:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1877052324153088:0@lo:8:kworker.0 00000100:00100000:2.0:1790096954.760106:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324153344:0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.760185:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.760224:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096954.760231:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324153472:0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.760272:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.760307:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153216 00000100:00100000:2.0:1790096954.760315:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153216 00000100:00100000:2.0:1790096954.760358:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153344 00000100:00100000:2.0:1790096954.760361:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153344 00000100:00100000:2.0:1790096954.760384:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153472 00000100:00100000:2.0:1790096954.760386:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153472 00000100:00100000:2.0:1790096954.760399:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096954.760407:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324153216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.760460:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324153216:12345-0@lo:400:kworker.0 Request processed in 53us (10871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096954.760467:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096954.760482:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096954.760489:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324153344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.760517:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324153344:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096954.760524:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096954.760535:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790096954.760541:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324153472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096954.760566:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324153472:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096954.760571:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790096954.760590:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790096954.760620:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b7aa00 x1877052324153216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096954.760663:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324153216:0@lo:400:kworker.0 00010000:00080000:2.0:1790096954.760710:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b79880 x1877052324153472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096954.760719:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324153472:0@lo:400:kworker.0 00010000:00080000:2.0:1790096954.760730:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaf3b79f80 x1877052324153344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790096954.760739:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324153344:0@lo:400:kworker.0 00000004:00080000:2.0:1790096954.764334:0:14461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790096954.764957:0:14461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484335321077ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790096954.765023:0:14462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790096954.765049:0:14462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1877052324153728:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790096954.765114:0:14462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.765141:0:14462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0e29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790096954.765165:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096954.765190:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.765238:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153728 00000100:00100000:2.0:1790096954.765246:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153728 00000100:00100000:2.0:1790096954.765298:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096954.765307:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14462:x1877052324153728:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790096954.768383:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaef5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324152832:12345-0@lo:400:kworker.0 Request processed in 18957us (19266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096954.768397:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790096954.768436:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153600 00000100:00100000:0.0:1790096954.768444:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153600 00000100:00100000:0.0:1790096954.768493:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790096954.768502:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877052324153600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096954.768553:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096954.768619:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877052324153600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (3428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096954.768627:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790096954.768703:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaad57e5f80 x1877052324153600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790096970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790096954.768738:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324153600:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1790096954.775001:0:15710:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790096954.775012:0:15710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1790096954.775018:0:15710:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1790096954.777202:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324152832:0@lo:400:kworker.0 00000100:00080000:3.0:1790096954.784622:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1790096954.810050:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.810064:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810080:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.810086:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.810092:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810109:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810119:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810126:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810145:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.810157:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.810163:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810170:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.810181:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810190:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810206:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810214:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c90d5c/0xcc97d9eae5ab6b90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810230:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.810232:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.810233:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.810738:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.810745:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810754:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.810758:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.810762:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810771:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810779:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810794:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810808:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.810817:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.810822:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810829:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690e00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.810833:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810841:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810853:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810861:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000232eabb7/0xcc97d9eae5ab6b97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.810875:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.810877:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.810879:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.811303:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.811316:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811326:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.811329:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.811334:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811344:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811353:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811360:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811373:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.811383:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.811387:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811394:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.811398:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811406:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811424:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811432:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cd3bfd1/0xcc97d9eae5ab6b9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811445:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.811447:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.811449:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.811875:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.811881:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811890:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.811894:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.811898:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811908:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811917:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.811925:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820136:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.820151:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.820158:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820166:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.820171:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820182:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820201:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820209:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000680526a1/0xcc97d9eae5ab6ba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.820230:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.820232:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.820233:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.830598:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.830615:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.832230:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.832248:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.832258:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.832276:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.832287:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.832296:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.832320:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790096954.834139:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.834150:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834164:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.834169:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.834175:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834187:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834198:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834214:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834237:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790096954.834255:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096954.834262:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834271:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.834276:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834285:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834304:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834311:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b465cb9/0xcc97d9eae5ab6bac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834331:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.834335:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834351:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.834354:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834361:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834370:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834376:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019d85f96/0xcc97d9eae5ab6bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.834388:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.834390:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.834391:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096954.834779:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.840151:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.840165:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.840181:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.840185:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.840192:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.840206:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.840222:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.840229:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.840247:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790096954.840761:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096954.840769:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.840790:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8691400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096954.840794:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.840802:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.840822:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.840830:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b17dab/0xcc97d9eae5ab6bba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.840849:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.840851:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.840853:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.842830:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.842845:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.842860:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.842865:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.842871:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.842885:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.842895:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.842903:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.842950:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790096954.843474:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.843480:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.843488:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.843491:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.843496:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.843506:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.843514:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.843521:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.843540:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790096954.844777:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790096954.844789:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844800:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac8690200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096954.844804:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844815:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844837:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844844:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f244e3/0xcc97d9eae5ab6bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844870:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790096954.844874:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844881:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240c600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096954.844884:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844905:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844917:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844924:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e7d1a1/0xcc97d9eae5ab6bc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.844948:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096954.844950:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096954.844952:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.847457:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.847469:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847484:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.847494:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.847501:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847515:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847526:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847535:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847555:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.847567:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.847573:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847580:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.847584:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847593:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847611:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847627:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366a8bb1/0xcc97d9eae5ab6bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.847688:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.847691:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.847692:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.850554:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.850567:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850583:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.850588:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.850594:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850609:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850620:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850629:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850681:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.850699:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.850711:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850720:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.850725:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850735:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850750:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850757:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505d23df/0xcc97d9eae5ab6bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.850782:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.850784:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.850786:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.851249:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.851256:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851265:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.851269:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.851273:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851295:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851304:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851312:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851326:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.851334:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.851338:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851345:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240ce00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.851349:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851358:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851370:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851377:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b9cda6/0xcc97d9eae5ab6bdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851396:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.851398:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.851400:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.851802:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.851808:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851816:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.851819:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.851823:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851832:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851839:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851846:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851859:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.851866:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.851870:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851886:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240c000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.851889:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851896:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851908:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851915:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161d7771/0xcc97d9eae5ab6be4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.851941:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.851942:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.851944:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.852324:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.852330:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852338:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.852341:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.852346:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852354:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852367:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852374:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852386:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.852394:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.852398:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852405:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240da00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.852408:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852415:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852426:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852432:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000736ccd08/0xcc97d9eae5ab6beb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852445:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.852452:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.852453:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.852888:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.852894:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852902:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.852905:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.852909:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852918:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852942:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852950:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852964:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.852972:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.852976:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.852983:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240dc00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.852986:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853005:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853016:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853024:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853038:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.853040:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.853042:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.853426:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.853432:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853439:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.853442:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.853446:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853454:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853461:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853474:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853488:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790096954.853497:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.853501:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853507:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240c400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.853510:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853518:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853528:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853535:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6bf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.853548:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.853550:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.853551:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.856526:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096954.888965:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096954.888978:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.888995:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1790096954.889000:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096954.889007:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889034:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889046:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889054:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889074:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790096954.889426:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096954.889432:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889441:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1790096954.889445:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096954.889449:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889457:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889464:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889479:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889493:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790096954.889507:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790096954.889512:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889519:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841c00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096954.889523:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889532:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889547:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889554:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca266ae9/0xcc97d9eae5ab6c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889570:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096954.889573:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889590:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096954.889593:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889601:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889610:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889617:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.889628:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.889630:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.901740:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790096954.902472:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790096954.902483:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902499:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1790096954.902504:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096954.902511:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902525:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902543:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902550:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902569:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790096954.902582:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096954.902588:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902596:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096954.902600:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902609:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.902627:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.905309:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.905860:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dd3d9c4/0xcc97d9eae5ab6c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096954.905888:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.905896:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096954.905898:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790096954.910629:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790096954.915580:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.915601:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1790096954.915606:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096954.915613:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.915631:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.915817:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.915824:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.922822:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790096954.923461:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.923471:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.923487:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.923492:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.923499:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.923514:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.923525:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.923540:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.923564:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790096954.923764:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096954.923773:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923781:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240c400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.923786:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923796:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923821:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923829:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c4599cd/0xcc97d9eae5ab6c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923847:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.923850:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923856:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.923860:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923867:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923876:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923884:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.923896:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.923898:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.923909:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790096954.928563:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.928576:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.928591:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.928595:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.928601:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.928614:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.928623:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.928631:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.928822:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790096954.929243:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.929249:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.929265:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.929268:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.929272:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.929282:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.929290:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.929296:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.929305:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790096954.929980:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790096954.929989:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.929999:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096954.930005:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930016:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930036:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930043:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d0fdb2e/0xcc97d9eae5ab6c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930060:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096954.930064:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930070:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096954.930074:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930093:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930103:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930109:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ddc597/0xcc97d9eae5ab6c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.930135:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.930136:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.930138:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.930371:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790096954.932088:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.932100:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.932115:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.932119:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.932125:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.932137:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.932161:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.932168:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.932449:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790096954.937264:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096954.937278:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.937292:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096954.937296:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.937306:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.937327:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.937346:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033da2fb6/0xcc97d9eae5ab6c31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.937367:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.937369:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.937371:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790096954.938049:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1790096954.938228:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.938237:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.938251:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.938256:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.938263:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.938276:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.938286:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.938293:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.938357:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790096954.940228:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.940240:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.940254:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.940258:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.940263:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.940274:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.940284:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.940291:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.954773:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096954.954788:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.954811:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148fe00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.954816:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.954828:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.954850:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.954857:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524f30c0/0xcc97d9eae5ab6c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.955004:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790096954.955010:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.955017:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148ea00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096954.955021:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.955028:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.955039:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.955047:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.955049:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.955051:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096954.964909:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790096954.964934:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced4622e/0xcc97d9eae5ab6c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790096954.965591:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.965599:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.965619:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.965623:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.965629:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096954.965722:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096954.972785:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.972810:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.972819:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.972852:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790096954.973507:0:15710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790096954.973515:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.973526:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1790096954.973530:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096954.973535:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.973543:0:15710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.973563:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.973570:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096954.973599:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1790096954.973802:0:15710:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1790096954.973904:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14462:x1877052324153728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 208595us (208786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096954.973918:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790096954.974088:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096954.974096:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974105:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f200 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.974109:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974130:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974148:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974156:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd9842a/0xcc97d9eae5ab6c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974176:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096954.974180:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974187:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096954.974190:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974197:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974206:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974212:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096954.974235:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.974237:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096954.974239:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096954.974300:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096954.982025:0:14462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaad57e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1877052324153728:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790096954.982046:0:14462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790096954.982108:0:14462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1877052324153856:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790096954.982161:0:14462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096954.982220:0:14462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861780 going to sleep for 11 seconds 00000100:00100000:0.0:1790096954.982294:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153856 00000100:00100000:0.0:1790096954.982301:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153856 00000100:00100000:0.0:1790096954.982354:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790096954.982363:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1877052324153856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790096954.982406:0:15124:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1790096954.998578:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14462:x1877052324153856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16209us (16410us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790096954.998591:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790096954.999781:0:14462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1877052324153856:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790096954.999806:0:14462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1790096955.265342:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790096955.487117:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790096955.487192:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790096956.285998:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096956.797826:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324153984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096956.797897:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096956.798046:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324153984 00000100:00100000:1.0:1790096956.798053:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324153984 00000100:00100000:1.0:1790096956.798117:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790096956.798126:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324153984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790096956.798158:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790096956.798225:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096956.798310:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324153984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096956.798318:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790096956.798448:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324153984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790096957.314214:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096957.703917:0:16198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790096958.333131:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096958.782623:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790096959.357168:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096959.870074:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324154112:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870154:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.870200:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324154624:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870227:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.870251:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790096959.870258:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324154240:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870282:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.870300:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324154752:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870325:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.870353:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324154368:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870375:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.870393:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096959.870398:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324154496:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.870418:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.871214:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154112 00000100:00100000:1.0:1790096959.871225:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154112 00000100:00100000:1.0:1790096959.871272:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790096959.871282:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324154112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.871342:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324154112:12345-0@lo:400:kworker.0 Request processed in 62us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.871350:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790096959.871384:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154624 00000100:00100000:1.0:1790096959.871388:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154624 00000100:00100000:1.0:1790096959.871421:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154752 00000100:00100000:1.0:1790096959.871424:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154752 00000100:00100000:1.0:1790096959.872978:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154496 00000100:00100000:1.0:1790096959.872989:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154496 00000100:00100000:1.0:1790096959.873015:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790096959.873030:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324154624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.873092:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324154624:12345-0@lo:400:kworker.0 Request processed in 64us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.873098:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790096959.873114:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790096959.873119:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324154752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.873144:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877052324154752:12345-0@lo:400:kworker.0 Request processed in 25us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.873150:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790096959.873162:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790096959.873168:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324154496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.873209:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324154496:12345-0@lo:400:kworker.0 Request processed in 41us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.873214:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790096959.873235:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154240 00000100:00100000:1.0:1790096959.873239:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154240 00000100:00100000:1.0:1790096959.873267:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154368 00000100:00100000:1.0:1790096959.873269:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154368 00000100:00100000:1.0:1790096959.873289:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790096959.873295:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324154240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.873326:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324154240:12345-0@lo:400:kworker.0 Request processed in 31us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.873331:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790096959.873342:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790096959.873347:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.873372:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324154368:12345-0@lo:400:kworker.0 Request processed in 26us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096959.873385:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790096959.873417:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790096959.873421:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096959.873423:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790096959.875138:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9bb80 x1877052324154496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790096959.875155:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324154496:0@lo:400:kworker.0 00000100:00100000:3.0:1790096959.875167:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790096959.875180:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324154368:0@lo:400:kworker.0 00000100:00100000:0.0:1790096959.875509:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324154880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096959.875564:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096959.876350:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324154240:0@lo:400:kworker.0 00010000:00080000:1.0:1790096959.876365:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe98000 x1877052324154752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096959.876375:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1877052324154752:0@lo:400:kworker.0 00000100:00100000:1.0:1790096959.876384:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324154112:0@lo:400:kworker.0 00010000:00080000:1.0:1790096959.876393:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eaaffe9b480 x1877052324154624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790096975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790096959.876401:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324154624:0@lo:400:kworker.0 00000100:00100000:0.0:1790096959.879135:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324154880 00000100:00100000:0.0:1790096959.879146:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324154880 00000100:00100000:0.0:1790096959.879199:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790096959.879208:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324154880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096959.879243:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096959.879313:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324154880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096959.879319:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790096959.879374:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324154880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096960.120201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096960.120546:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284096 00000100:00100000:0.0:1790096960.120569:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284096 00000100:00100000:0.0:1790096960.120616:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1790096960.120625:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1877052305284096:12345-192.168.203.11@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790096960.120692:0:14431:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7c8194b6-07c2-49a7-bf7e-91daaed3f55e@192.168.203.11@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1790096960.120734:0:14431:0:(genops.c:1384:class_connect()) connect: client 7c8194b6-07c2-49a7-bf7e-91daaed3f55e, cookie 0xcc97d9eae5ab6c54 00000100:00080000:0.0:1790096960.121070:0:14431:0:(import.c:65:import_set_state_nolock()) ffff9eaac427a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790096960.121134:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+5:2359:x1877052305284096:12345-192.168.203.11@tcp:250:mount.lustre.0 Request processed in 508us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096960.121142:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1790096960.135802:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.136901:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284224 00000100:00100000:2.0:1790096960.136914:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284224 00000100:00100000:2.0:1790096960.137132:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1790096960.137144:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+5:13746:x1877052305284224:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790096960.137162:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096960.137181:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaace841200/0xcc97d9eae5ab6c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38212ab expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.137211:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaace841200/0xcc97d9eae5ab6c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212ab expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.137242:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaace841200/0xcc97d9eae5ab6c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212ab expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.137251:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace841200, rc 0) 00000100:00100000:2.0:1790096960.137317:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+6:13746:x1877052305284224:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 176us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.137325:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1790096960.142326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.142479:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284352 00000100:00100000:1.0:1790096960.142489:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284352 00000100:00100000:1.0:1790096960.142547:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790096960.142557:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+6:13746:x1877052305284352:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790096960.144230:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+6:13746:x1877052305284352:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 1668us (1908us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790096960.144242:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790096960.149842:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.149992:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284480 00000100:00100000:2.0:1790096960.150002:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284480 00000100:00100000:2.0:1790096960.150052:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1790096960.150061:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+6:13746:x1877052305284480:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790096960.150078:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096960.150094:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaace840400/0xcc97d9eae5ab6c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38212b2 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.150122:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaace840400/0xcc97d9eae5ab6c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212b2 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.150133:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaace840400/0xcc97d9eae5ab6c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212b2 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.150141:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace840400, rc 0) 00000100:00100000:2.0:1790096960.150203:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+7:13746:x1877052305284480:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.150211:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1790096960.158211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.162030:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284608 00000100:00100000:1.0:1790096960.162044:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284608 00000100:00100000:2.0:1790096960.162906:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:2.0:1790096960.162919:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+7:13746:x1877052305284608:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790096960.163379:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13746:x1877052305284608:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 461us (5176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.163388:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:3.0:1790096960.169862:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096960.170748:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284736 00000100:00100000:0.0:1790096960.170769:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284736 00000100:00100000:0.0:1790096960.170868:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1790096960.170879:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13746:x1877052305284736:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790096960.171217:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13746:x1877052305284736:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 340us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096960.171226:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1790096960.186663:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.187302:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284864 00000100:00100000:2.0:1790096960.187313:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284864 00000100:00100000:2.0:1790096960.187411:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:2.0:1790096960.187422:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13764:x1877052305284864:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096960.187826:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13764:x1877052305284864:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 404us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.187835:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1790096960.222752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096960.224276:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305284992 00000100:00100000:0.0:1790096960.224289:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305284992 00000100:00100000:0.0:1790096960.224361:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1790096960.224376:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13764:x1877052305284992:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790096960.225098:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13764:x1877052305284992:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 724us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096960.225108:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1790096960.230382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.237142:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285120 00000100:00100000:2.0:1790096960.237155:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285120 00000100:00100000:2.0:1790096960.237230:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1790096960.237247:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+8:13746:x1877052305285120:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790096960.237268:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096960.237288:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaace841400/0xcc97d9eae5ab6c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38212dc expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.237317:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaace841400/0xcc97d9eae5ab6c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212dc expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.237327:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaace841400/0xcc97d9eae5ab6c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212dc expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096960.237336:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace841400, rc 0) 00000100:00100000:2.0:1790096960.237421:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+9:13746:x1877052305285120:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 176us (7050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.237428:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1790096960.245351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.245434:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285248 00000100:00100000:1.0:1790096960.245444:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285248 00000100:00100000:1.0:1790096960.245497:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1790096960.245506:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+9:13746:x1877052305285248:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790096960.245531:0:14431:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790096960.245555:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790096960.245559:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790096960.245562:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790096960.245564:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790096960.249732:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+9:13746:x1877052305285248:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 4218us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.249743:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:3.0:1790096960.255387:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.255481:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285376 00000100:00100000:1.0:1790096960.255491:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285376 00000100:00100000:1.0:1790096960.255552:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:1.0:1790096960.255563:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+9:13746:x1877052305285376:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790096960.255579:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096960.255598:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38212e3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.255627:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.255680:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.255689:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e800, rc 0) 00000100:00100000:1.0:1790096960.255747:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13746:x1877052305285376:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 186us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.255767:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1790096960.258131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.258209:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285504 00000100:00100000:1.0:1790096960.258219:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285504 00000100:00100000:1.0:1790096960.258276:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1790096960.258286:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13746:x1877052305285504:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790096960.258581:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13746:x1877052305285504:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 295us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.258589:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1790096960.261165:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.261260:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285632 00000100:00100000:2.0:1790096960.261269:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285632 00000100:00100000:2.0:1790096960.261321:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:2.0:1790096960.261339:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13746:x1877052305285632:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790096960.262359:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13746:x1877052305285632:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 1024us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096960.262371:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1790096960.266049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.267440:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285760 00000100:00100000:2.0:1790096960.267453:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285760 00000100:00100000:2.0:1790096960.267517:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:2.0:1790096960.267527:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad5764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13769:x1877052305285760:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790096960.268335:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad5764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13769:x1877052305285760:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 805us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096960.268345:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:1.0:1790096960.277041:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096960.277296:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305285888 00000100:00100000:3.0:1790096960.277307:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305285888 00000100:00100000:3.0:1790096960.277366:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1790096960.277377:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13769:x1877052305285888:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790096960.277679:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13769:x1877052305285888:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 303us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096960.277893:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:1.0:1790096960.288391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.289110:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286016 00000100:00100000:2.0:1790096960.289121:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286016 00000100:00100000:2.0:1790096960.289170:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790096960.289179:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1877052305286016:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790096960.289206:0:14438:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 33f27a14-2671-4c80-af2e-5328abffbff3@192.168.203.11@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1790096960.289252:0:14438:0:(genops.c:1384:class_connect()) connect: client 33f27a14-2671-4c80-af2e-5328abffbff3, cookie 0xcc97d9eae5ab6c77 00000004:00100000:2.0:1790096960.289280:0:14438:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790096960.289285:0:14438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1790096960.361291:0:14438:0:(import.c:65:import_set_state_nolock()) ffff9eaac9b16000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790096960.361423:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+6:2359:x1877052305286016:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 72243us (73041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.361435:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790096960.365416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.365510:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286272 00000100:00100000:2.0:1790096960.365511:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.365521:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286272 00000100:00100000:1.0:1790096960.365591:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286144 00000100:00100000:1.0:1790096960.365595:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286144 00000100:00080000:0.0:1790096960.365598:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096960.365616:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790096960.365626:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+7:13746:x1877052305286272:12345-192.168.203.11@tcp:41:mount.lustre.0 00000100:00100000:0.0:1790096960.365626:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1790096960.365656:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+7:0:x1877052305286144:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790096960.365696:0:14438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790096960.365786:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+7:0:x1877052305286144:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 153us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096960.365795:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000004:00000024:2.0:1790096960.368801:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790096960.368913:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:13746:x1877052305286272:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 3282us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096960.368922:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790096960.372002:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096960.372419:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286400 00000100:00100000:0.0:1790096960.372430:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286400 00000100:00100000:0.0:1790096960.372591:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790096960.372602:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+6:13746:x1877052305286400:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790096960.372721:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+6:13746:x1877052305286400:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 121us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096960.372728:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790096960.376554:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096960.376607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096960.376754:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286784 00000100:00100000:2.0:1790096960.376773:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286784 00000100:00100000:2.0:1790096960.376824:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790096960.376834:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:13746:x1877052305286784:12345-192.168.203.11@tcp:33:mount.lustre.0 00000100:00100000:3.0:1790096960.377153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.377215:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286528 00000100:00100000:1.0:1790096960.377219:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286528 00000100:00100000:1.0:1790096960.377248:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286656 00000100:00100000:1.0:1790096960.377251:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286656 00000100:00100000:1.0:1790096960.377269:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096960.377275:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1877052305286528:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790096960.377319:0:15122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 33f27a14-2671-4c80-af2e-5328abffbff3@192.168.203.11@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1790096960.377353:0:15122:0:(genops.c:1384:class_connect()) connect: client 33f27a14-2671-4c80-af2e-5328abffbff3, cookie 0xcc97d9eae5ab6c7e 00002000:00100000:1.0:1790096960.377363:0:15122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33f27a14-2671-4c80-af2e-5328abffbff3/ffff9eaac9b17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790096960.377385:0:15122:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790096960.377764:0:15122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790096960.377796:0:15122:0:(import.c:65:import_set_state_nolock()) ffff9eaac37f3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790096960.377854:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:2359:x1877052305286528:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 578us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.377862:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096960.377880:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790096960.377897:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1877052305286656:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790096960.377914:0:15122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 33f27a14-2671-4c80-af2e-5328abffbff3@192.168.203.11@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1790096960.377933:0:15122:0:(genops.c:1384:class_connect()) connect: client 33f27a14-2671-4c80-af2e-5328abffbff3, cookie 0xcc97d9eae5ab6c85 00002000:00100000:1.0:1790096960.377939:0:15122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33f27a14-2671-4c80-af2e-5328abffbff3/ffff9eaac37f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790096960.377945:0:15122:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790096960.378150:0:15122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790096960.378165:0:15122:0:(import.c:65:import_set_state_nolock()) ffff9eaac37f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790096960.378190:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:2359:x1877052305286656:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 302us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.378196:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000004:00080000:3.0:1790096960.380218:0:14440:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3311us 00010000:00010000:3.0:1790096960.386114:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1790096960.399483:0:14440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790096960.399599:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:13746:x1877052305286784:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 22761us (23049us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096960.399613:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000001:00100000:2.0:1790096960.428149:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33f27a14-2671-4c80-af2e-5328abffbff3 00000100:00100000:3.0:1790096960.612417:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096960.612501:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305286912 00000100:00100000:1.0:1790096960.612511:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305286912 00000100:00100000:1.0:1790096960.612572:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1790096960.612582:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+6:13790:x1877052305286912:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1790096960.612622:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096960.612695:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab6c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382130d expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.612977:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.612992:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.613006:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096960.613049:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790096960.613053:0:15854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790096960.613089:0:15854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.613116:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ea00/0xcc97d9eae5ab6c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382130d expref: 8 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.613135:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382130d expref: 7 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096960.613143:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:1.0:1790096960.613147:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790096960.613151:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f200, rc 0) 00000100:00100000:1.0:1790096960.613212:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+7:13790:x1877052305286912:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 631us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096960.613228:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00010000:00010000:2.0:1790096961.405784:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096961.920313:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096961.920337:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324155008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096961.920409:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096961.920580:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155008 00000100:00100000:2.0:1790096961.920588:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155008 00000100:00100000:2.0:1790096961.922598:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096961.922616:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324155008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096961.922670:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096961.922758:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324155008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096961.922766:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790096961.922845:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324155008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790096961.923159:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790096962.429507:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790096962.721212:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.721350:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287040 00000100:00100000:1.0:1790096962.721360:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287040 00000100:00100000:1.0:1790096962.721438:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790096962.721450:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:13843:x1877052305287040:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1790096962.721492:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790096962.721585:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:13843:x1877052305287040:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.721593:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00080000:0.0:1790096962.721839:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096962.731244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.731355:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287168 00000100:00100000:1.0:1790096962.731365:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287168 00000100:00100000:1.0:1790096962.731445:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790096962.731456:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33f27a14-2671-4c80-af2e-5328abffbff3+6:13843:x1877052305287168:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1790096962.731483:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096962.731578:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33f27a14-2671-4c80-af2e-5328abffbff3+6:13843:x1877052305287168:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 123us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.731586:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00080000:0.0:1790096962.731761:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790096962.735407:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.736983:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287296 00000100:00100000:1.0:1790096962.736995:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287296 00000100:00100000:1.0:1790096962.737157:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1790096962.737169:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33f27a14-2671-4c80-af2e-5328abffbff3+5:13843:x1877052305287296:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1790096962.737210:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790096962.737304:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33f27a14-2671-4c80-af2e-5328abffbff3+5:13843:x1877052305287296:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 137us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.737325:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00080000:0.0:1790096962.745349:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790096962.924582:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.924665:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287424 00000100:00100000:1.0:1790096962.924684:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287424 00000100:00100000:1.0:1790096962.924741:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1790096962.924759:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+10:13878:x1877052305287424:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790096962.924777:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096962.924796:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab6c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821314 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.924824:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab6c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821314 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.924836:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148ea00/0xcc97d9eae5ab6c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821314 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.924845:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148ea00, rc 0) 00000100:00100000:1.0:1790096962.924934:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305287424:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.924942:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1790096962.932033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.932130:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287552 00000100:00100000:1.0:1790096962.932141:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287552 00000100:00100000:1.0:1790096962.932197:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:1.0:1790096962.932208:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305287552:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790096962.932603:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305287552:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 396us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.932612:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:2.0:1790096962.942099:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096962.942188:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287680 00000100:00100000:3.0:1790096962.942198:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287680 00000100:00100000:3.0:1790096962.942255:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:3.0:1790096962.942267:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305287680:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790096962.942500:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305287680:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 235us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096962.942510:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1790096962.949791:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.950208:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287808 00000100:00100000:1.0:1790096962.950223:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287808 00000100:00100000:1.0:1790096962.950303:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1790096962.950316:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13882:x1877052305287808:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790096962.950732:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13882:x1877052305287808:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 419us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.950749:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1790096962.966412:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.966559:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305287936 00000100:00100000:1.0:1790096962.966574:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305287936 00000100:00100000:1.0:1790096962.966699:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:1.0:1790096962.966712:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac9678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13882:x1877052305287936:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790096962.967107:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac9678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13882:x1877052305287936:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 397us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096962.967118:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1790096962.976752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096962.982413:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288064 00000100:00100000:1.0:1790096962.982437:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288064 00000100:00100000:1.0:1790096962.982535:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790096962.982549:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13878:x1877052305288064:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790096962.982573:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096962.982599:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab6ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382133e expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.982680:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab6ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382133e expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.982695:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148fe00/0xcc97d9eae5ab6ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382133e expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096962.982734:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fe00, rc 0) 00000100:00100000:0.0:1790096962.986670:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13878:x1877052305288064:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 4088us (9907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096962.986691:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:2.0:1790096962.989988:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096962.990164:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288192 00000100:00100000:3.0:1790096962.990178:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288192 00000100:00100000:3.0:1790096962.990254:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:3.0:1790096962.990285:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13878:x1877052305288192:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790096962.990320:0:14429:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790096962.990342:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790096962.990346:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790096962.990350:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790096962.990353:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790096963.004110:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13878:x1877052305288192:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 13808us (14119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096963.004129:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:2.0:1790096963.007721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096963.007836:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288320 00000100:00100000:0.0:1790096963.007876:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288320 00000100:00100000:0.0:1790096963.007943:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:0.0:1790096963.007956:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaac967bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13878:x1877052305288320:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790096963.007979:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096963.008003:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821345 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096963.008043:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096963.008056:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096963.008068:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9c240c800, rc 0) 00000100:00100000:0.0:1790096963.008142:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaac967bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13878:x1877052305288320:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 188us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096963.008158:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:2.0:1790096963.011751:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096963.011946:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288448 00000100:00100000:0.0:1790096963.011962:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288448 00000100:00100000:0.0:1790096963.012047:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:0.0:1790096963.012060:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13878:x1877052305288448:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790096963.012489:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13878:x1877052305288448:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 431us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096963.012498:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:2.0:1790096963.017332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096963.017525:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288576 00000100:00100000:1.0:1790096963.017539:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288576 00000100:00100000:1.0:1790096963.017617:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1790096963.017628:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13878:x1877052305288576:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790096963.017967:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13878:x1877052305288576:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 339us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096963.017977:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1790096963.022330:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096963.022701:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288704 00000100:00100000:2.0:1790096963.022716:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288704 00000100:00100000:2.0:1790096963.022799:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:2.0:1790096963.022812:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13886:x1877052305288704:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790096963.023381:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13886:x1877052305288704:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 569us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096963.023391:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:2.0:1790096963.030843:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096963.030958:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288832 00000100:00100000:0.0:1790096963.030973:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288832 00000100:00100000:0.0:1790096963.031088:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:0.0:1790096963.031101:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13886:x1877052305288832:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790096963.031488:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13886:x1877052305288832:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 387us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096963.031498:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:3.0:1790096963.052039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096963.052330:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305288960 00000100:00100000:2.0:1790096963.052346:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305288960 00000100:00100000:2.0:1790096963.052414:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790096963.052424:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1877052305288960:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790096963.052462:0:14439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b0703d30-934a-4288-bec0-100b2251de1f@192.168.203.11@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1790096963.052517:0:14439:0:(genops.c:1384:class_connect()) connect: client b0703d30-934a-4288-bec0-100b2251de1f, cookie 0xcc97d9eae5ab6caf 00000004:00100000:2.0:1790096963.052563:0:14439:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790096963.052800:0:14439:0:(import.c:65:import_set_state_nolock()) ffff9eaafbcbe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096963.052901:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0703d30-934a-4288-bec0-100b2251de1f+6:2359:x1877052305288960:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 475us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096963.052911:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096963.056184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096963.056388:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289344 00000100:00100000:1.0:1790096963.056401:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289344 00000100:00100000:1.0:1790096963.056476:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790096963.056487:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2362:x1877052305289344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096963.056583:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2362:x1877052305289344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 97us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096963.056592:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790096963.056963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096963.058238:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289472 00000100:00100000:1.0:1790096963.058254:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289472 00000100:00100000:1.0:1790096963.058347:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790096963.058358:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:2363:x1877052305289472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096963.058447:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+6:2363:x1877052305289472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096963.058455:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790096963.075352:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096963.075398:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096963.075502:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289216 00000100:00100000:3.0:1790096963.075516:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289216 00000100:00100000:3.0:1790096963.075603:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289088 00000100:00100000:3.0:1790096963.075607:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289088 00000100:00100000:3.0:1790096963.075670:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790096963.075683:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+7:13878:x1877052305289216:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790096963.075728:0:15854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790096963.075827:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+7:13878:x1877052305289216:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 145us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096963.075835:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790096963.075856:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1790096963.075863:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:0:x1877052305289088:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790096963.075886:0:15854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790096963.075907:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:0:x1877052305289088:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 46us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096963.075913:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00080000:0.0:1790096963.076529:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096963.083543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096963.083697:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289600 00000100:00100000:1.0:1790096963.083711:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289600 00000100:00100000:1.0:1790096963.083802:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790096963.083815:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:13878:x1877052305289600:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790096963.083943:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:13878:x1877052305289600:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 130us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096963.083952:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790096963.087312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096963.087350:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096963.087381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096963.087481:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289728 00000100:00100000:2.0:1790096963.087496:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289728 00000100:00100000:2.0:1790096963.087547:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289856 00000100:00100000:2.0:1790096963.087550:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289856 00000100:00100000:2.0:1790096963.087573:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790096963.087583:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1877052305289728:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790096963.087626:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b0703d30-934a-4288-bec0-100b2251de1f@192.168.203.11@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1790096963.087704:0:15125:0:(genops.c:1384:class_connect()) connect: client b0703d30-934a-4288-bec0-100b2251de1f, cookie 0xcc97d9eae5ab6cb6 00002000:00100000:2.0:1790096963.087718:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b0703d30-934a-4288-bec0-100b2251de1f/ffff9eaafbcb9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790096963.087731:0:15125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790096963.087920:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790096963.087965:0:15125:0:(import.c:65:import_set_state_nolock()) ffff9eaac3090800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096963.088047:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+6:2359:x1877052305289728:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 464us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096963.088055:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790096963.088077:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790096963.088082:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1877052305289856:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790096963.088099:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b0703d30-934a-4288-bec0-100b2251de1f@192.168.203.11@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1790096963.088117:0:15125:0:(genops.c:1384:class_connect()) connect: client b0703d30-934a-4288-bec0-100b2251de1f, cookie 0xcc97d9eae5ab6cbd 00002000:00100000:2.0:1790096963.088135:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b0703d30-934a-4288-bec0-100b2251de1f/ffff9eaac3096000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790096963.088142:0:15125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790096963.088561:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790096963.088583:0:15125:0:(import.c:65:import_set_state_nolock()) ffff9eaac3092800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790096963.088619:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+6:2359:x1877052305289856:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 534us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096963.088627:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790096963.088805:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305289984 00000100:00100000:1.0:1790096963.088814:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305289984 00000100:00100000:1.0:1790096963.088873:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1790096963.088883:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:13878:x1877052305289984:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790096963.088967:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790096963.089027:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:13878:x1877052305289984:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 146us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096963.089034:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790096963.297837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096963.298123:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290112 00000100:00100000:2.0:1790096963.298139:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290112 00000100:00100000:2.0:1790096963.298223:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096963.298236:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:13907:x1877052305290112:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:2.0:1790096963.298265:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096963.298298:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840000/0xcc97d9eae5ab6cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382136f expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298383:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298429:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298448:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096963.298497:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790096963.298502:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096963.298530:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298562:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840000/0xcc97d9eae5ab6cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298587:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096963.298606:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096963.298610:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096963.298615:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace841a00, rc 0) 00000100:00100000:2.0:1790096963.299014:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+7:13907:x1877052305290112:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 778us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096963.299023:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00010000:00010000:2.0:1790096963.453843:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790096964.476791:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096964.989099:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324155264:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989194:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989257:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324155776:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989285:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989314:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790096964.989320:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324155136:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989350:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989372:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324155648:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989396:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989422:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324155392:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989446:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989462:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096964.989468:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324155520:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989488:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.989524:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155776 00000100:00100000:0.0:1790096964.989533:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155776 00000100:00100000:0.0:1790096964.989592:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155648 00000100:00100000:0.0:1790096964.989611:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155648 00000100:00100000:0.0:1790096964.989630:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155520 00000100:00100000:0.0:1790096964.989656:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155520 00000100:00100000:0.0:1790096964.989676:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790096964.989686:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324155776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989750:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324155776:12345-0@lo:400:kworker.0 Request processed in 66us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096964.989757:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790096964.989776:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790096964.989782:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324155648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989808:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324155648:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096964.989813:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790096964.989824:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790096964.989830:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324155520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989895:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324155520:12345-0@lo:400:kworker.0 Request processed in 65us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096964.989901:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790096964.989920:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790096964.989961:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324155520:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.989994:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324155648:0@lo:400:kworker.0 00000100:00100000:0.0:1790096964.990004:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324155776:0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.990486:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155264 00000100:00100000:2.0:1790096964.990492:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155264 00000100:00100000:2.0:1790096964.990540:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155392 00000100:00100000:2.0:1790096964.990544:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155392 00000100:00100000:2.0:1790096964.990570:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096964.990588:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.990658:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaad57e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324155264:12345-0@lo:400:kworker.0 Request processed in 72us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096964.990665:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790096964.990693:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096964.990701:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324155392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.990732:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324155392:12345-0@lo:400:kworker.0 Request processed in 33us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096964.990738:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790096964.990759:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155136 00000100:00100000:2.0:1790096964.990762:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155136 00000100:00100000:2.0:1790096964.990792:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790096964.990800:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.990834:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324155136:12345-0@lo:400:kworker.0 Request processed in 35us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096964.990840:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1790096964.990913:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096964.990916:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096964.990937:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324155136:0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.990951:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324155264:0@lo:400:kworker.0 00000100:00100000:1.0:1790096964.991120:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096964.991134:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324155904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790096964.991183:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096964.991389:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324155392:0@lo:400:kworker.0 00000100:00100000:2.0:1790096964.991452:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324155904 00000100:00100000:2.0:1790096964.991457:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324155904 00000100:00100000:2.0:1790096964.991495:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790096964.991502:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324155904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096964.991537:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096964.991589:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324155904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096964.991607:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790096964.991904:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324155904:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1790096965.063970:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33f27a14-2671-4c80-af2e-5328abffbff3 00000001:00100000:1.0:1790096965.063998:0:6721:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b0703d30-934a-4288-bec0-100b2251de1f 00010000:00010000:2.0:1790096965.502150:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790096965.584090:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33f27a14-2671-4c80-af2e-5328abffbff3 00000001:00100000:0.0:1790096965.584119:0:5874:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b0703d30-934a-4288-bec0-100b2251de1f 00000001:00100000:1.0:1790096965.588958:0:7663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0703d30-934a-4288-bec0-100b2251de1f 00010000:00010000:1.0:1790096966.527868:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790096966.658248:0:16404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790096967.037159:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790096967.037187:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096967.037283:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096967.044489:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156032 00000100:00100000:2.0:1790096967.044512:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156032 00000100:00100000:2.0:1790096967.045142:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790096967.045156:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096967.045209:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096967.045319:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (8036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096967.045326:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790096967.045474:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790096967.047204:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790096967.551556:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096968.371693:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371890:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371908:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096968.371959:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290240 00000100:00100000:3.0:1790096968.371967:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290240 00000100:00100000:3.0:1790096968.372015:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:3.0:1790096968.372025:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2362:x1877052305290240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.372092:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2362:x1877052305290240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.372100:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:3.0:1790096968.372131:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290496 00000100:00100000:3.0:1790096968.372135:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290496 00000100:00100000:3.0:1790096968.372165:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291008 00000100:00100000:3.0:1790096968.372168:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291008 00000100:00100000:3.0:1790096968.372182:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290624 00000100:00100000:3.0:1790096968.372185:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290624 00000100:00100000:3.0:1790096968.372194:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290880 00000100:00100000:3.0:1790096968.372196:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290880 00000100:00100000:3.0:1790096968.372209:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790096968.372224:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2362:x1877052305290496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.372254:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2362:x1877052305290496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.372261:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790096968.372273:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790096968.372280:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:2362:x1877052305291008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.372304:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:2362:x1877052305291008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.372309:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790096968.372320:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096968.372325:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2362:x1877052305290624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.372344:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2362:x1877052305290624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.372350:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096968.372359:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790096968.372365:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:2362:x1877052305290880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.372387:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:2362:x1877052305290880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.372393:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790096968.372410:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290752 00000100:00100000:3.0:1790096968.372414:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290752 00000100:00100000:3.0:1790096968.374356:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305290368 00000100:00100000:3.0:1790096968.374367:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305290368 00000100:00100000:3.0:1790096968.374414:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790096968.374799:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1790096968.374810:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:2362:x1877052305290368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096968.374893:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:2362:x1877052305290368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 86us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096968.374906:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790096968.376235:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:2362:x1877052305290752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096968.376293:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+6:2362:x1877052305290752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096968.376302:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00080000:3.0:1790096968.378944:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790096968.378954:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790096968.378957:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790096968.577534:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096969.022692:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790096969.597342:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096970.109089:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324156288:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109162:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109216:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324156800:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109243:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109266:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790096970.109272:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324156160:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109298:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109322:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324156672:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109341:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156416:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109387:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109405:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096970.109410:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324156544:0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109428:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.109456:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156288 00000100:00100000:1.0:1790096970.109463:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156288 00000100:00100000:1.0:1790096970.109513:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156416 00000100:00100000:1.0:1790096970.109517:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156416 00000100:00100000:1.0:1790096970.109541:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790096970.109550:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324156288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.109598:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324156288:12345-0@lo:400:kworker.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096970.109605:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790096970.109653:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790096970.109659:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.110337:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156416:12345-0@lo:400:kworker.0 Request processed in 676us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096970.110345:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790096970.110369:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156800 00000100:00100000:1.0:1790096970.110373:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156800 00000100:00100000:1.0:1790096970.110409:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156672 00000100:00100000:1.0:1790096970.110412:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156672 00000100:00100000:1.0:1790096970.110424:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156544 00000100:00100000:1.0:1790096970.110426:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156544 00000100:00100000:1.0:1790096970.110440:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096970.110446:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.110481:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324156800:12345-0@lo:400:kworker.0 Request processed in 35us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096970.110487:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790096970.110498:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790096970.110504:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096970.110530:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877052324156672:12345-0@lo:400:kworker.0 Request processed in 26us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096970.110536:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790096970.110547:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790096970.110552:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324156544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790096970.116938:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790096970.116948:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790096970.116951:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096970.116978:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156160 00000100:00100000:2.0:1790096970.116988:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156160 00000100:00100000:2.0:1790096970.117049:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790096970.117059:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324156160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.117149:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:3317:x1877052324156160:12345-0@lo:400:kworker.0 Request processed in 92us (7850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096970.117158:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790096970.117238:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cee436cd-c034-4d15-b596-e9f7d5252125:3317:1877052324156160:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.117253:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1877052324156672:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.117264:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324156288:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.117275:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324156800:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.117335:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096970.117369:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096970.122093:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324156544:12345-0@lo:400:kworker.0 Request processed in 11528us (12651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096970.122109:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790096970.126664:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324156544:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.126695:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156416:0@lo:400:kworker.0 00000100:00100000:2.0:1790096970.127729:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324156928 00000100:00100000:2.0:1790096970.127739:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324156928 00000100:00100000:2.0:1790096970.127830:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790096970.127840:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096970.127879:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096970.127971:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324156928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (10601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096970.127978:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790096970.128326:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324156928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790096970.625086:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790096970.831568:0:16553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffffe01cc0 20000000:00000080:0.0:1790096970.831586:0:16553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eaad576f400 uarg=0000000000000000 20000000:01000000:0.0:1790096970.831623:0:16553:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790096970.831629:0:16553:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790096970.832901:0:16553:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790096970.838213:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1790096970.841874:0:16553:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790096970.854623:0:16553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790096970.858507:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858540:0:16553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858547:0:16553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858553:0:16553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858561:0:16553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858568:0:16553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858576:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858616:0:16553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.858662:0:16553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 12 pid: 14431 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.858679:0:16553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157056:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096970.859004:0:16553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.859014:0:16553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 12 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.859030:0:16553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157184:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096970.859063:0:16553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.859071:0:16553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.859080:0:16553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157312:0@lo:104: 00000100:00100000:1.0:1790096970.859115:0:16553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096970.859193:0:16553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.859201:0:16553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 18 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.859210:0:16553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157440:0@lo:104: 00000100:00100000:1.0:1790096970.859230:0:16553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790096970.863462:0:16553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.863480:0:16553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 18 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.863495:0:16553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157568:0@lo:104: 00000100:00100000:1.0:1790096970.863557:0:16553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096970.863703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096970.863771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096970.867904:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157312 00000100:00100000:0.0:1790096970.867920:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157312 00000100:00100000:0.0:1790096970.867984:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157440 00000100:00100000:0.0:1790096970.867988:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157440 00000100:00100000:0.0:1790096970.868007:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790096970.868019:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+4:16553:x1877052324157312:12345-0@lo:104: 00010000:00010000:0.0:1790096970.868038:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868136:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096970.868143:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+4:16553:x1877052324157312:12345-0@lo:104: Request processed in 126us (9027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.868149:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790096970.868170:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790096970.868191:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:16553:x1877052324157440:12345-0@lo:104: 00010000:00010000:0.0:1790096970.868200:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868237:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790096970.868242:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:16553:x1877052324157440:12345-0@lo:104: Request processed in 53us (9012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.868248:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790096970.868286:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790096970.868291:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868300:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840800 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096970.868305:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868313:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096970.868321:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096970.868326:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790096970.868362:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868369:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096970.868387:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868405:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaace840800/0xcc97d9eae5ab6b43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6b4a expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868418:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096970.868422:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868427:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096970.868430:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868436:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096970.868443:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096970.868448:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790096970.868460:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868466:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096970.868491:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868497:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6400/0xcc97d9eae5ab6a0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab6a16 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868506:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096970.868513:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096970.868515:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096970.868521:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096970.868543:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324157696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096970.868585:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096970.868630:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324157824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096970.868674:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096970.868695:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291136 00000100:00100000:0.0:1790096970.868699:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291136 00010000:00010000:0.0:1790096970.868720:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 13 pid: 14431 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096970.868734:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291264 00000100:00100000:0.0:1790096970.868737:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291264 00010000:00010000:0.0:1790096970.868746:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 14 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096970.868755:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157696 00000100:00100000:0.0:1790096970.868757:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157696 00010000:00010000:0.0:1790096970.868767:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 19 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096970.868775:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157824 00000100:00100000:0.0:1790096970.868777:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157824 00010000:00010000:0.0:1790096970.868786:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 20 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096970.868797:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790096970.868802:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+14:2363:x1877052305291136:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096970.868826:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096970.868838:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 14 pid: 14431 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868847:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 14 pid: 14431 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868864:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096970.868906:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+14:2363:x1877052305291136:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 103us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.868914:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790096970.868928:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790096970.868935:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2363:x1877052305291264:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096970.868942:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096970.868946:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 13 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868955:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 13 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.868964:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096970.868979:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2363:x1877052305291264:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 45us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.868985:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790096970.868996:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096970.869001:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+20:3315:x1877052324157696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096970.869009:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096970.869012:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 20 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.869031:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 20 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.869041:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096970.869071:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+20:3315:x1877052324157696:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.869078:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096970.869118:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096970.869124:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324157824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096970.869131:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096970.869136:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 19 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.869143:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 19 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.869152:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096970.869175:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324157824:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.869180:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790096970.869333:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324157824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096970.869356:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cee436cd-c034-4d15-b596-e9f7d5252125:3315:1877052324157696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790096970.870916:0:16553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142e40 going to sleep for 11 seconds 00010000:00010000:1.0:1790096970.870950:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9c240c800/0xcc97d9eae5ab6ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821345 expref: 12 pid: 14431 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.870986:0:16553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157056:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096970.871004:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148e800/0xcc97d9eae5ab6c70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38212e3 expref: 11 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.871012:0:16553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157184:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096970.871021:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8691800/0xcc97d9eae5ab6b4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab6b43 expref: 18 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.871029:0:16553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157312:0@lo:104: 00010000:00010000:1.0:1790096970.871037:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac8690600/0xcc97d9eae5ab6a16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab6a0f expref: 17 pid: 14430 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.871045:0:16553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157440:0@lo:104: 00000100:00100000:0.0:1790096970.871147:0:14420:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790096970.871165:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157568 00000100:00100000:0.0:1790096970.871172:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157568 00000100:00100000:0.0:1790096970.871210:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790096970.871220:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb40c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:16553:x1877052324157568:12345-0@lo:104: 00010000:00010000:0.0:1790096970.871240:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871353:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790096970.871360:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb40c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cee436cd-c034-4d15-b596-e9f7d5252125+3:16553:x1877052324157568:12345-0@lo:104: Request processed in 143us (7803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.871367:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790096970.871408:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790096970.871414:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871421:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1a67c20) 10000000:00010000:0.0:1790096970.871425:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871433:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790096970.871441:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096970.871447:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790096970.871479:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871486:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790096970.871500:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871506:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff9eaaffcf6e00/0xcc97d9eae5ab69c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc97d9eae5ab69c9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871527:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096970.871529:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790096970.871530:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096970.871543:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790096970.871554:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324157952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790096970.871589:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096970.871613:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324157952 00000100:00100000:0.0:1790096970.871617:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324157952 00010000:00010000:0.0:1790096970.871632:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 17 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096970.871665:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790096970.871671:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+17:3316:x1877052324157952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790096970.871681:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096970.871686:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 17 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871695:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 17 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871711:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871719:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871733:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871750:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871756:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871762:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871768:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096970.871772:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871780:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871789:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096970.871798:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096970.871841:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cee436cd-c034-4d15-b596-e9f7d5252125+17:3316:x1877052324157952:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096970.871848:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790096970.871876:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324157952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790096970.875874:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab69c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc97d9eae5ab69c2 expref: 16 pid: 14429 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096970.875894:0:16553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16553:1877052324157568:0@lo:104: 00010000:00010000:1.0:1790096970.875931:0:16553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.875941:0:16553:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.875947:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096970.875952:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eaac148f800/0xcc97d9eae5ab6cd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096971.645960:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790096972.029187:0:14435:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790096972.029195:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaac3de7000 from 10 10000000:01000000:0.0:1790096972.029200:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790096972.029242:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.029259:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.029271:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096972.029296:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.029361:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096972.029415:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac38613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096972.029468:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158080 00000100:00100000:2.0:1790096972.029476:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158080 00000100:00100000:2.0:1790096972.029530:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790096972.029540:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+16:14435:x1877052324158080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790096972.029553:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096972.029566:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaace840000/0xcc97d9eae5ab6ce0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6cd9 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096972.029587:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaace840000/0xcc97d9eae5ab6ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6cd9 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096972.029609:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaace840000/0xcc97d9eae5ab6ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6cd9 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096972.029618:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace840000, rc 0) 00000100:00100000:2.0:1790096972.029703:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096972.029710:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790096972.029811:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096972.029826:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6ce0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.029836:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6ce0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096972.029893:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096972.029921:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096972.029951:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae61423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096972.030189:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158208 00000100:00100000:2.0:1790096972.030194:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158208 00000100:00100000:2.0:1790096972.030219:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790096972.030225:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790096972.030549:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096972.030556:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790096972.030609:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790096972.031731:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096972.031780:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096972.031819:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae61423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790096972.031834:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158336 00000100:00100000:1.0:1790096972.031839:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158336 00000100:00100000:1.0:1790096972.031871:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790096972.031878:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790096972.032038:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096972.032045:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790096972.032091:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790096972.040454:0:16591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790096972.055977:0:14435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790096972.056020:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096972.056048:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6ce0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.056060:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c800/0xcc97d9eae5ab6cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6ce0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790096972.056071:0:14435:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790096972.056074:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eaaff0eb000 from 10 10000000:01000000:1.0:1790096972.056077:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790096972.056114:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.056122:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.056131:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096972.056156:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790096972.056227:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096972.056279:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae61423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096972.056345:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158464 00000100:00100000:3.0:1790096972.056353:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158464 00000100:00100000:3.0:1790096972.056401:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790096972.056410:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+17:14435:x1877052324158464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096972.056422:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096972.056435:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf7600/0xcc97d9eae5ab6cee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6ce7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.056457:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf7600/0xcc97d9eae5ab6cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6ce7 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.056467:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf7600/0xcc97d9eae5ab6cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6ce7 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.056475:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7600, rc 0) 00000100:00100000:3.0:1790096972.056514:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096972.056522:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790096972.056565:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096972.056578:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cee expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.056594:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6cee expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096972.056664:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.056689:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096972.056708:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3416480 going to sleep for 11 seconds 00000100:00100000:3.0:1790096972.056720:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158592 00000100:00100000:3.0:1790096972.056723:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158592 00000100:00100000:3.0:1790096972.056741:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790096972.056746:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.057014:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096972.057021:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790096972.057052:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.057077:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.057125:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096972.057138:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac52f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790096972.057149:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158720 00000100:00100000:3.0:1790096972.057152:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158720 00000100:00100000:3.0:1790096972.057169:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790096972.057174:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff6e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.057968:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff6e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 789us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096972.057977:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790096972.057990:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790096972.065972:0:16593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790096972.067001:0:14435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790096972.067027:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790096972.067039:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cee expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.067053:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9eaac148f800/0xcc97d9eae5ab6ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cee expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790096972.067064:0:14435:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790096972.067067:0:14435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea9c3140800 from 10 10000000:01000000:0.0:1790096972.067070:0:14435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790096972.067105:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.067113:0:14435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.067124:0:14435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096972.067157:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb157800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.067221:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096972.067264:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861540 going to sleep for 11 seconds 00000100:00100000:3.0:1790096972.074262:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158848 00000100:00100000:3.0:1790096972.074278:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158848 00000100:00100000:3.0:1790096972.074349:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790096972.074359:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+18:14435:x1877052324158848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096972.074376:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096972.074393:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaaffcf6c00/0xcc97d9eae5ab6cfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc97d9eae5ab6cf5 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.074418:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaaffcf6c00/0xcc97d9eae5ab6cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6cf5 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.074430:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaaffcf6c00/0xcc97d9eae5ab6cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc97d9eae5ab6cf5 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.074439:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6c00, rc 0) 00000100:00100000:3.0:1790096972.074514:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324158848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (7293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096972.074521:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790096972.074573:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb157800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790096972.074590:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cfc expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096972.074600:0:14435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc97d9eae5ab6cfc expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096972.074686:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.074717:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096972.074775:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac52f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1790096972.074790:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324158976 00000100:00100000:3.0:1790096972.074793:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324158976 00000100:00100000:3.0:1790096972.074832:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790096972.074839:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324158976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790096972.075066:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324158976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096972.075073:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790096972.075829:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.076012:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaafb154000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324159104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.076062:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096972.076083:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac3861540 going to sleep for 11 seconds 00000100:00100000:2.0:1790096972.076214:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159104 00000100:00100000:2.0:1790096972.076220:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159104 00000100:00100000:2.0:1790096972.076254:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790096972.076261:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324159104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096972.076488:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cee436cd-c034-4d15-b596-e9f7d5252125+19:14435:x1877052324159104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096972.076495:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790096972.079977:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaafb154000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cee436cd-c034-4d15-b596-e9f7d5252125:14435:1877052324159104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790096972.097064:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790096972.097676:0:14435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790096972.097705:0:14435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790096972.097717:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cfc expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.097728:0:14435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff9ea9c240c000/0xcc97d9eae5ab6cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc97d9eae5ab6cfc expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096972.156826:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790096972.156851:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790096972.156922:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096972.157021:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159232 00000100:00100000:2.0:1790096972.157029:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159232 00000100:00100000:2.0:1790096972.157107:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790096972.157118:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324159232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096972.157170:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096972.157230:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324159232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096972.157238:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790096972.157289:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790096972.158676:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790096972.342220:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096972.342290:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291392 00000100:00100000:1.0:1790096972.342305:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291392 00000100:00100000:1.0:1790096972.342355:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790096972.342365:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+11:13760:x1877052305291392:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790096972.342381:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096972.342396:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab6d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821376 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.342423:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821376 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.342434:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eaac148fc00/0xcc97d9eae5ab6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821376 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096972.342443:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148fc00, rc 0) 00000100:00100000:1.0:1790096972.342490:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291392:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096972.342497:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:0.0:1790096972.351942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096972.351985:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291520 00000100:00100000:0.0:1790096972.351996:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291520 00000100:00100000:0.0:1790096972.352043:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1790096972.352052:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291520:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.352320:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291520:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 268us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096972.352329:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:2.0:1790096972.358730:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096972.358762:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291648 00000100:00100000:2.0:1790096972.358771:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291648 00000100:00100000:2.0:1790096972.358829:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:2.0:1790096972.358839:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291648:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790096972.359036:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291648:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 198us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096972.359043:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:2.0:1790096972.382852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096972.390807:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291776 00000100:00100000:0.0:1790096972.390823:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291776 00000100:00100000:0.0:1790096972.390885:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1790096972.390896:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+12:13760:x1877052305291776:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790096972.390915:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790096972.390934:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9c240ce00/0xcc97d9eae5ab6d0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382137d expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.390981:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9c240ce00/0xcc97d9eae5ab6d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382137d expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.390993:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9c240ce00/0xcc97d9eae5ab6d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382137d expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096972.391001:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9c240ce00, rc 0) 00000100:00100000:0.0:1790096972.391070:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13760:x1877052305291776:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 176us (8224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096972.391076:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1790096972.397899:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096972.397948:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305291904 00000100:00100000:0.0:1790096972.397957:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305291904 00000100:00100000:0.0:1790096972.397998:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1790096972.398008:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13760:x1877052305291904:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.398284:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13760:x1877052305291904:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 275us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096972.398293:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1790096972.409989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096972.410056:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292032 00000100:00100000:0.0:1790096972.410066:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292032 00000100:00100000:0.0:1790096972.410115:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790096972.410125:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13760:x1877052305292032:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790096972.410327:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:13760:x1877052305292032:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 204us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096972.410336:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00010000:00010000:1.0:1790096972.669068:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790096973.482839:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482945:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482962:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096973.482984:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096973.483148:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292160 00000100:00100000:1.0:1790096973.483159:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292160 00000100:00100000:0.0:1790096973.483225:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292416 00000100:00100000:0.0:1790096973.483230:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292416 00000100:00100000:1.0:1790096973.497192:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790096973.497211:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2360:x1877052305292160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096973.497343:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2360:x1877052305292160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 138us (14513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096973.497350:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1790096973.500414:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292672 00000100:00100000:0.0:1790096973.500428:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292672 00000100:00100000:0.0:1790096973.500487:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292288 00000100:00100000:0.0:1790096973.500492:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292288 00000100:00100000:0.0:1790096973.500523:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790096973.500532:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:2360:x1877052305292672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096973.500601:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:2360:x1877052305292672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (17695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096973.500608:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790096973.500712:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790096973.500719:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+6:2360:x1877052305292288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096973.500741:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+6:2360:x1877052305292288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (17796us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096973.500747:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790096973.500764:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292928 00000100:00100000:0.0:1790096973.500767:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292928 00000100:00100000:0.0:1790096973.500782:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292544 00000100:00100000:0.0:1790096973.500784:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292544 00000100:00100000:0.0:1790096973.500805:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305292800 00000100:00100000:0.0:1790096973.500820:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305292800 00000100:00100000:0.0:1790096973.500840:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790096973.500846:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0703d30-934a-4288-bec0-100b2251de1f+5:2360:x1877052305292928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096973.500872:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0703d30-934a-4288-bec0-100b2251de1f+5:2360:x1877052305292928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (17946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096973.500878:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790096973.500891:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790096973.500896:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305292544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096973.500916:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305292544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (17953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096973.500922:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790096973.500934:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790096973.500939:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0703d30-934a-4288-bec0-100b2251de1f+5:2360:x1877052305292800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096973.500961:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0703d30-934a-4288-bec0-100b2251de1f+5:2360:x1877052305292800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (17976us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096973.500966:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00080000:0.0:1790096973.500992:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790096973.500996:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790096973.501708:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096973.503966:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790096973.503982:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305292416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096973.507490:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305292416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3015us (24114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096973.507505:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00010000:00010000:0.0:1790096973.692852:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096974.718087:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790096975.229096:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324159616:0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.229203:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096975.229264:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790096975.229270:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324159488:0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.229297:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096975.229314:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324160000:0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.229337:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324159744:0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.229339:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096975.229379:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096975.229427:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790096975.229434:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cee436cd-c034-4d15-b596-e9f7d5252125:3314:1877052324159360:0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.229464:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096975.229499:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaff0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324159872:0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.229524:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096975.229565:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159360 00000100:00100000:2.0:1790096975.229574:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159360 00000100:00100000:2.0:1790096975.229620:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790096975.229630:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:3314:x1877052324159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.229699:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cee436cd-c034-4d15-b596-e9f7d5252125+19:3314:x1877052324159360:12345-0@lo:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096975.229707:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790096975.229736:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324160000 00000100:00100000:2.0:1790096975.229770:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cee436cd-c034-4d15-b596-e9f7d5252125:3314:1877052324159360:0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.229820:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324160000 00000100:00080000:2.0:1790096975.229862:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096975.229870:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159744 00000100:00100000:1.0:1790096975.229875:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159744 00000100:00100000:2.0:1790096975.229887:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159872 00000100:00100000:2.0:1790096975.229893:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159872 00000100:00100000:1.0:1790096975.229895:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790096975.229906:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324160000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.229929:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790096975.229939:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.229954:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324160000:12345-0@lo:400:kworker.0 Request processed in 49us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096975.229962:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790096975.229979:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790096975.229986:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877052324159744:12345-0@lo:400:kworker.0 Request processed in 48us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096975.229988:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324159872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.230000:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790096975.230021:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096975.230028:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877052324159872:12345-0@lo:400:kworker.0 Request processed in 42us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096975.230042:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1877052324159872:0@lo:400:kworker.0 00000100:00100000:2.0:1790096975.230053:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877052324159744:0@lo:400:kworker.0 00000100:00100000:1.0:1790096975.230113:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790096975.230144:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324160000:0@lo:400:kworker.0 00000100:00100000:0.0:1790096975.230656:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159616 00000100:00100000:0.0:1790096975.230662:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159616 00000100:00100000:0.0:1790096975.230696:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324159488 00000100:00100000:0.0:1790096975.230699:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324159488 00000100:00100000:0.0:1790096975.230720:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790096975.230728:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324159616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096975.231112:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790096975.231124:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324159488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096975.231184:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324159488:12345-0@lo:400:kworker.0 Request processed in 64us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.231201:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790096975.231239:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324159488:0@lo:400:kworker.0 00000100:00100000:0.0:1790096975.231542:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324159616:12345-0@lo:400:kworker.0 Request processed in 814us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096975.231551:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790096975.231565:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790096975.231579:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324160128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096975.231615:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096975.231705:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324160128 00000100:00100000:0.0:1790096975.231711:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324160128 00000100:00100000:0.0:1790096975.231863:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096975.231872:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324160128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790096975.231898:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790096975.231934:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877052324160128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096975.231940:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790096975.231970:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1877052324160128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790096975.232057:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324159616:0@lo:400:kworker.0 00000100:00080000:1.0:1790096975.232392:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790096975.232398:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096975.244530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.244916:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293056 00000100:00100000:2.0:1790096975.244928:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293056 00000100:00100000:2.0:1790096975.245029:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:1.0:1790096975.245206:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790096975.245816:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:14418:x1877052305293056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096975.245837:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096975.245859:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821384 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245936:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245952:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245964:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245979:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245986:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.245992:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246319:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840c00/0xcc97d9eae5ab6d26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246328:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840c00/0xcc97d9eae5ab6d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246336:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840c00/0xcc97d9eae5ab6d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096975.246389:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790096975.246393:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096975.246434:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840c00/0xcc97d9eae5ab6d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246445:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246452:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246459:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246465:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096975.246469:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246477:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246489:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:2.0:1790096975.246492:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096975.246497:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246503:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840800/0xcc97d9eae5ab6d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246516:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246531:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246537:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246541:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096975.246544:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246550:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246557:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eaad1cb8e00) 00010000:00010000:2.0:1790096975.246560:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096975.246563:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246569:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246605:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821384 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246619:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840c00/0xcc97d9eae5ab6d26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821384 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.246626:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaad1cb8200) 00010000:00010000:2.0:1790096975.246628:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096975.246687:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace840c00, rc 0) 00000100:00100000:2.0:1790096975.246760:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+7:14418:x1877052305293056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 952us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096975.250194:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096975.251023:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293312 00000100:00100000:0.0:1790096975.251054:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293312 00000100:00100000:2.0:1790096975.252948:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790096975.253386:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790096975.253420:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+7:14418:x1877052305293312:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096975.253442:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096975.253465:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6d2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382138b expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253547:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253561:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253573:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253626:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253659:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.253667:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254240:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e400/0xcc97d9eae5ab6d42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254251:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e400/0xcc97d9eae5ab6d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254259:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e400/0xcc97d9eae5ab6d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096975.254281:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790096975.254491:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254501:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254507:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254514:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096975.254518:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254525:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254537:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eaad1cb8200) 00010000:00010000:1.0:1790096975.254539:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096975.254545:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254551:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6d34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254563:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254569:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254585:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254590:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096975.254593:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254600:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254608:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eaac4db7900) 00010000:00010000:1.0:1790096975.254610:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096975.254614:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.254620:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6d3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.264616:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6d2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382138b expref: 10 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.264859:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e400/0xcc97d9eae5ab6d42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382138b expref: 9 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.264870:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7f00) 00010000:00010000:1.0:1790096975.264873:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096975.264877:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148e400, rc 0) 00000100:00100000:0.0:1790096975.265350:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+9:14418:x1877052305293312:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 11934us (15167us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790096975.265360:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790096975.283126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.283246:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293440 00000100:00100000:3.0:1790096975.283256:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293440 00000100:00100000:3.0:1790096975.283327:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790096975.283338:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+9:14418:x1877052305293440:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790096975.283446:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+9:14418:x1877052305293440:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.283468:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790096975.311757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.311870:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293568 00000100:00100000:3.0:1790096975.311881:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293568 00000100:00100000:3.0:1790096975.311938:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790096975.311949:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+9:14424:x1877052305293568:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096975.311973:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.312014:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821392 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312097:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312111:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312123:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312137:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312143:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312150:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312348:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312366:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312372:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312378:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.312382:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312389:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312401:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096975.312404:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.312409:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312416:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312429:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312436:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312441:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312446:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.312455:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312462:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312470:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096975.312472:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.312475:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312480:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312512:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821392 expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312522:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096975.312525:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.312529:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821392 expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.312538:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096975.312615:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+9:14424:x1877052305293568:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 668us (879us total) trans 0 rc 301/301 00000100:00100000:3.0:1790096975.312623:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790096975.316257:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.318870:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293696 00000100:00100000:3.0:1790096975.318885:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293696 00000100:00100000:3.0:1790096975.318945:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790096975.318954:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:33f27a14-2671-4c80-af2e-5328abffbff3+9:14424:x1877052305293696:12345-192.168.203.11@tcp:700:lfs.0 00000100:00100000:3.0:1790096975.319187:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:33f27a14-2671-4c80-af2e-5328abffbff3+9:14424:x1877052305293696:12345-192.168.203.11@tcp:700:lfs.0 Request processed in 233us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.319194:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790096975.326449:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.326545:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305293952 00000100:00100000:3.0:1790096975.326556:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305293952 00000100:00100000:3.0:1790096975.326618:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1790096975.326629:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+9:14424:x1877052305293952:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1790096975.326706:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096975.326732:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f200/0xcc97d9eae5ab6c93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382130d expref: 9 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.326887:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096975.326893:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096975.327221:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.327237:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.327246:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.327282:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.327298:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 5 pid: 14438 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096975.327328:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14437:1877052324160256:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096975.327438:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac52f49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790096975.330015:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14437:1877052324160256:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096975.330058:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096975.332373:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096975.332546:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294080 00000100:00100000:0.0:1790096975.332556:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294080 00010000:00010000:0.0:1790096975.332609:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 6 pid: 14438 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096975.332686:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790096975.332695:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0703d30-934a-4288-bec0-100b2251de1f+6:2362:x1877052305294080:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096975.332709:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096975.332729:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 6 pid: 14438 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332750:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 6 pid: 14438 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332774:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841a00/0xcc97d9eae5ab6ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382136f expref: 6 pid: 14438 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332801:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:0.0:1790096975.332807:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332817:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332824:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.332848:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096975.332893:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:2362:x1877052305294080:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096975.332901:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00080000:1.0:1790096975.333167:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790096975.333421:0:14437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.333431:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.333462:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.333471:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.333480:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.336916:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790096975.336935:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.336945:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.336954:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.336967:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.336971:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.336978:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.336994:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac4db7b00) 00010000:00010000:3.0:1790096975.336997:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.337001:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.337008:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096975.337027:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002a58f59 reply state 000000001ee06cbf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096975.337517:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096975.337630:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+10:14424:x1877052305293952:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 11000us (11188us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790096975.338943:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:2.0:1790096975.349218:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349239:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349247:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349253:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096975.349258:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349266:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349282:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eaac2c3c300) 00010000:00010000:2.0:1790096975.349285:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096975.349290:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.349295:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6d6c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096975.476441:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.476686:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294208 00000100:00100000:3.0:1790096975.476696:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294208 00000100:00100000:3.0:1790096975.476770:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790096975.476791:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+9:14432:x1877052305294208:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:3.0:1790096975.476819:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.476842:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821399 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.476933:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.476947:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.476961:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.476998:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096975.477003:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096975.477041:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.477065:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821399 expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.477082:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6a00/0xcc97d9eae5ab6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821399 expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.477090:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096975.477093:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096975.477097:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6a00, rc 0) 00000100:00100000:3.0:1790096975.477159:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+10:14432:x1877052305294208:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 371us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.477166:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790096975.562521:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.563074:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294336 00000100:00100000:2.0:1790096975.563090:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294336 00000100:00100000:2.0:1790096975.563182:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790096975.563197:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0703d30-934a-4288-bec0-100b2251de1f+5:14433:x1877052305294336:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096975.563252:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096975.563283:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6d81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213a0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563380:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563400:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563417:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096975.563463:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790096975.563468:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096975.563497:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563525:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6d81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213a0 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563550:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840a00/0xcc97d9eae5ab6d88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213a0 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.563561:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:2.0:1790096975.563564:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790096975.563569:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace840a00, rc 0) 00000100:00100000:2.0:1790096975.563709:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0703d30-934a-4288-bec0-100b2251de1f+6:14433:x1877052305294336:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 516us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096975.563726:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790096975.572609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.573265:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294464 00000100:00100000:3.0:1790096975.573287:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294464 00000100:00100000:3.0:1790096975.573459:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790096975.573472:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:14433:x1877052305294464:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096975.573512:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.573543:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213a7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573673:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573692:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573708:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573726:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573746:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.573754:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574522:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574547:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574561:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.574625:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096975.574630:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096975.574700:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574840:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574846:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574854:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574860:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.574865:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574873:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574887:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096975.574890:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.574895:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574900:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574919:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.574936:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575000:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575004:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.575007:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575013:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575022:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eaac2c3c700) 00010000:00010000:3.0:1790096975.575024:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.575027:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575033:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6d9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575076:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213a7 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575091:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213a7 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.575098:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3cf00) 00010000:00010000:3.0:1790096975.575100:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096975.575109:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7c00, rc 0) 00000100:00100000:3.0:1790096975.575260:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+7:14433:x1877052305294464:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1789us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.575270:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096975.584117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.584503:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294720 00000100:00100000:2.0:1790096975.584520:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294720 00000100:00100000:2.0:1790096975.584605:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1790096975.584618:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0703d30-934a-4288-bec0-100b2251de1f+7:14433:x1877052305294720:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790096975.584698:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096975.584726:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213ae expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096975.584956:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790096975.585107:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6dab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ae expref: 9 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.585124:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:2.0:1790096975.585127:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790096975.585133:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840600/0xcc97d9eae5ab6dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ae expref: 9 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.585151:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace840600, rc 0) 00000100:00100000:2.0:1790096975.585234:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0703d30-934a-4288-bec0-100b2251de1f+8:14433:x1877052305294720:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 620us (1129us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790096975.585242:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1790096975.589137:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096975.589248:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305294976 00000100:00100000:0.0:1790096975.589259:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305294976 00000100:00100000:0.0:1790096975.589325:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1790096975.589337:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+8:14433:x1877052305294976:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:0.0:1790096975.589398:0:15854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096975.589435:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6da4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213a7 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.589456:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3cf00) 00010000:00010000:0.0:1790096975.589467:0:15854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096975.589494:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.589507:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.589519:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096975.590436:0:15854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e02489f6 reply state 00000000760f47e0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096975.590449:0:15854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790096975.590458:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790096975.590550:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+9:14433:x1877052305294976:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1212us (1419us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790096975.590558:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00010000:00010000:0.0:1790096975.593474:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593492:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593501:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593508:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096975.593526:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593534:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593550:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096975.593553:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790096975.593558:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.593564:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d000/0xcc97d9eae5ab6db9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096975.594436:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.595078:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305295232 00000100:00100000:2.0:1790096975.595089:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305295232 00000100:00100000:2.0:1790096975.595192:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790096975.595204:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0703d30-934a-4288-bec0-100b2251de1f+8:14433:x1877052305295232:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790096975.595467:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0703d30-934a-4288-bec0-100b2251de1f+9:14433:x1877052305295232:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 265us (1036us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790096975.595475:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1790096975.604474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096975.605083:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305295488 00000100:00100000:1.0:1790096975.605097:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305295488 00000100:00100000:1.0:1790096975.605174:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790096975.605185:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0703d30-934a-4288-bec0-100b2251de1f+9:14433:x1877052305295488:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790096975.605212:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096975.605234:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213b5 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605309:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605323:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605336:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605352:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605361:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605387:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790096975.605492:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790096975.605582:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605590:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605598:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605605:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096975.605609:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605617:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605629:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:1.0:1790096975.605632:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096975.605848:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605857:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f600/0xcc97d9eae5ab6dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605871:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605888:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605895:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605900:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096975.605903:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605909:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605917:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eaac4db7d00) 00010000:00010000:1.0:1790096975.605920:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790096975.605922:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605928:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148e800/0xcc97d9eae5ab6dce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605972:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6dc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213b5 expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.605983:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:1.0:1790096975.605985:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790096975.605989:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213b5 expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096975.606010:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaac148f000, rc 0) 00000100:00100000:1.0:1790096975.606082:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0703d30-934a-4288-bec0-100b2251de1f+10:14433:x1877052305295488:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 900us (1620us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790096975.606090:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790096975.609726:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.609913:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305295616 00000100:00100000:3.0:1790096975.609922:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305295616 00000100:00100000:3.0:1790096975.609984:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790096975.609995:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+10:14433:x1877052305295616:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096975.610019:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.610040:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ddc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213bc expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610123:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610137:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610147:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.610172:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096975.610175:0:15854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096975.610193:0:15854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610220:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ddc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 12 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610256:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 11 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.610264:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3c700) 00010000:00010000:3.0:1790096975.610267:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790096975.610271:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7400, rc 0) 00000100:00100000:3.0:1790096975.610330:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0703d30-934a-4288-bec0-100b2251de1f+11:14433:x1877052305295616:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 337us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.610337:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790096975.619361:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096975.620218:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305295744 00000100:00100000:1.0:1790096975.620230:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305295744 00000100:00100000:1.0:1790096975.620290:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790096975.620299:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0703d30-934a-4288-bec0-100b2251de1f+11:14433:x1877052305295744:12345-192.168.203.11@tcp:37:lfs.0 00000100:00100000:0.0:1790096975.628105:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0703d30-934a-4288-bec0-100b2251de1f+11:14433:x1877052305295744:12345-192.168.203.11@tcp:37:lfs.0 Request processed in 7795us (8742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096975.628124:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790096975.635237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.635367:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296000 00000100:00100000:2.0:1790096975.635382:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296000 00000100:00100000:2.0:1790096975.635456:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790096975.635467:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf56dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0703d30-934a-4288-bec0-100b2251de1f+11:14433:x1877052305296000:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096975.636295:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf56dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0703d30-934a-4288-bec0-100b2251de1f+12:14433:x1877052305296000:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 825us (1072us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790096975.636306:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790096975.696495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.696689:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296128 00000100:00100000:3.0:1790096975.696705:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296128 00000100:00100000:3.0:1790096975.696804:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790096975.696815:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+10:14439:x1877052305296128:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096975.696851:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.696882:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213c3 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.696975:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.696994:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697009:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697047:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697056:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697063:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697200:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6dff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697210:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6dff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697218:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6dff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.697256:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790096975.697260:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096975.697312:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6dff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697327:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697335:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697343:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697361:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.697366:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697376:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697392:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096975.697395:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.697402:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697408:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697427:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697433:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697439:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697444:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.697447:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697453:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697471:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eaac2c3cb00) 00010000:00010000:3.0:1790096975.697473:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.697477:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697483:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6df8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697530:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213c3 expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697545:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7c00/0xcc97d9eae5ab6dff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213c3 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.697553:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3c700) 00010000:00010000:3.0:1790096975.697555:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790096975.697558:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7c00, rc 0) 00000100:00100000:3.0:1790096975.697719:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+11:14439:x1877052305296128:12345-192.168.203.11@tcp:101:bash.0 Request processed in 904us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.697731:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790096975.702010:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.702798:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296384 00000100:00100000:3.0:1790096975.702816:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296384 00000100:00100000:3.0:1790096975.703040:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790096975.703053:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+11:14439:x1877052305296384:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096975.703086:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.703115:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e06 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213ca expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.703322:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.703343:0:15854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 11 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.703353:0:15854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.703404:0:15854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 11 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.703420:0:15854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 11 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096975.703965:0:15854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1877052324160384:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096975.704160:0:15854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142900 going to sleep for 11 seconds 00000100:00100000:3.0:1790096975.708963:0:15854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1877052324160384:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096975.709006:0:15854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096975.709214:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.709331:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296512 00000100:00100000:2.0:1790096975.709342:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296512 00010000:00010000:2.0:1790096975.709398:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 12 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096975.709460:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790096975.709470:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0703d30-934a-4288-bec0-100b2251de1f+12:2362:x1877052305296512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096975.709489:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096975.709498:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 12 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709510:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 12 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709537:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6de3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213bc expref: 12 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709557:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3c700) 00010000:00010000:2.0:1790096975.709563:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709592:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709601:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.709632:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096975.710216:0:15854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.710229:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.710258:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.710275:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.710284:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711207:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711222:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711231:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.711244:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790096975.711280:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711288:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711296:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711302:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096975.711308:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711317:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711344:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3c700) 00010000:00010000:3.0:1790096975.711347:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096975.711353:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711360:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790096975.711375:0:15854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ac61586 reply state 00000000ef28f3d8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096975.711384:0:15854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790096975.711430:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e06 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 14 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711446:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 13 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.711453:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096975.711456:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1790096975.711458:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7200, rc 0) 00000100:00100000:2.0:1790096975.712423:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0703d30-934a-4288-bec0-100b2251de1f+11:2362:x1877052305296512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2941us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096975.712447:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790096975.717155:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+14:14439:x1877052305296384:12345-192.168.203.11@tcp:101:bash.0 Request processed in 14084us (15139us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1790096975.717172:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00010000:00010000:2.0:1790096975.722572:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722605:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722613:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722622:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096975.722627:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722662:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722682:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eaac2c3cb00) 00010000:00010000:2.0:1790096975.722685:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096975.722691:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.722723:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096975.732093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.732178:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296640 00000100:00100000:3.0:1790096975.732192:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296640 00000100:00100000:3.0:1790096975.732272:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1790096975.732284:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+13:14439:x1877052305296640:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790096975.732341:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.732371:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213d1 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732473:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732492:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732508:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.732559:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790096975.732565:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790096975.732587:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732600:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732630:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732711:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.732721:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096975.732725:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096975.732730:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7000, rc 0) 00000100:00100000:3.0:1790096975.732818:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+14:14439:x1877052305296640:12345-192.168.203.11@tcp:101:bash.0 Request processed in 536us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096975.732949:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1790096975.736981:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096975.737251:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305296896 00000100:00100000:0.0:1790096975.737265:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305296896 00000100:00100000:0.0:1790096975.737337:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790096975.737349:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+14:14439:x1877052305296896:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790096975.738516:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+15:14439:x1877052305296896:12345-192.168.203.11@tcp:35:bash.0 Request processed in 1160us (1540us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1790096975.738529:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00010000:00010000:2.0:1790096975.740836:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790096975.804030:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:0.0:1790096975.804127:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1790096975.804157:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1790096975.804165:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1790096975.845947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.846153:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305297152 00000100:00100000:3.0:1790096975.846167:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305297152 00000100:00100000:3.0:1790096975.846267:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1790096975.846278:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+11:14449:x1877052305297152:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096975.846319:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.846345:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213d8 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.846468:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790096975.846760:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d8 expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.846787:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eaac2c3c300) 00010000:00010000:3.0:1790096975.846790:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790096975.846797:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d8 expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.846826:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6400, rc 0) 00000100:00100000:3.0:1790096975.846896:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+12:14449:x1877052305297152:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 621us (964us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1790096975.846905:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1790096975.851540:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.851782:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305297408 00000100:00100000:3.0:1790096975.851796:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305297408 00000100:00100000:3.0:1790096975.851952:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790096975.851963:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+12:14449:x1877052305297408:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790096975.852397:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+13:14449:x1877052305297408:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 434us (870us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790096975.852405:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790096975.882485:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096975.882683:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305297664 00000100:00100000:3.0:1790096975.882698:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305297664 00000100:00100000:3.0:1790096975.882780:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790096975.882791:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+13:14452:x1877052305297664:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790096975.882822:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096975.882849:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213df expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.882995:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.883012:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.883027:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096975.883039:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790096975.883207:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213df expref: 16 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.883229:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213df expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096975.883239:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096975.883257:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096975.883261:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6e00, rc 0) 00000100:00100000:3.0:1790096975.883504:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+15:14452:x1877052305297664:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 711us (1030us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790096975.883515:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1790096975.890472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096975.890531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096975.890715:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305297920 00000100:00100000:2.0:1790096975.890729:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305297920 00000100:00100000:2.0:1790096975.890815:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790096975.890827:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33f27a14-2671-4c80-af2e-5328abffbff3+15:2361:x1877052305297920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790096975.890848:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790096975.890886:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213df expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096975.890918:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:2.0:1790096975.890924:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790096975.890994:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33f27a14-2671-4c80-af2e-5328abffbff3+14:2361:x1877052305297920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 169us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096975.891002:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790096975.891513:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305297792 00000100:00100000:0.0:1790096975.891522:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305297792 00000100:00100000:0.0:1790096975.891570:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1790096975.891577:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+14:14452:x1877052305297792:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790096975.891687:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891704:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891717:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891753:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891761:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891768:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891783:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096975.891788:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891797:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891832:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096975.891835:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790096975.891840:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096975.891847:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6e5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096975.892869:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+14:14452:x1877052305297792:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 1279us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096975.892883:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1790096975.895086:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096975.895185:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305298176 00000100:00100000:0.0:1790096975.895199:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305298176 00000100:00100000:0.0:1790096975.895471:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790096975.895486:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+14:14452:x1877052305298176:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790096975.896194:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+15:14452:x1877052305298176:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 708us (1118us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790096975.896203:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000040:00080000:1.0:1790096976.193137:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790096976.302800:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.302982:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305298432 00000100:00100000:3.0:1790096976.302998:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305298432 00000100:00100000:3.0:1790096976.303081:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790096976.303094:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+15:14483:x1877052305298432:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790096976.303123:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096976.303163:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213e6 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.303305:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.303322:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.303337:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096976.303353:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790096976.303553:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213e6 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.303577:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213e6 expref: 17 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.303609:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096976.303612:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790096976.303616:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6800, rc 0) 00000100:00100000:3.0:1790096976.303793:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+17:14483:x1877052305298432:12345-192.168.203.11@tcp:101:cat.0 Request processed in 702us (1007us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1790096976.303801:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1790096976.308966:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.309141:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305298688 00000100:00100000:3.0:1790096976.309155:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305298688 00000100:00100000:3.0:1790096976.309233:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790096976.309245:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+17:14483:x1877052305298688:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1790096976.309798:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+18:14483:x1877052305298688:12345-192.168.203.11@tcp:35:cat.0 Request processed in 552us (845us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790096976.309809:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1790096976.317946:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096976.318121:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305298816 00000100:00100000:0.0:1790096976.318135:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305298816 00000100:00100000:0.0:1790096976.318220:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790096976.318232:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+18:2363:x1877052305298816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096976.318252:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096976.318283:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213e6 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.318333:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096976.318339:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096976.318411:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+17:2363:x1877052305298816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 181us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096976.318420:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790096976.385246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.385361:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299072 00000100:00100000:3.0:1790096976.385374:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299072 00000100:00100000:3.0:1790096976.385470:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:3.0:1790096976.385482:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+17:14489:x1877052305299072:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790096976.385515:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096976.385542:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e76 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213ed expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385732:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385753:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385793:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385803:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385848:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.385863:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 18 pid: 14439 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096976.385878:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1877052324160512:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096976.386007:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.386018:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096976.386029:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1877052324160640:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096976.386344:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae6142c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790096976.393191:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1877052324160512:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096976.393211:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1877052324160640:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096976.393249:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096976.396184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096976.396239:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096976.396343:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299200 00000100:00100000:0.0:1790096976.396358:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299200 00010000:00010000:0.0:1790096976.396415:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 19 pid: 14439 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096976.396468:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299328 00000100:00100000:0.0:1790096976.396472:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299328 00010000:00010000:0.0:1790096976.396486:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 20 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096976.396504:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790096976.396514:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+20:2362:x1877052305299200:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096976.396538:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096976.396546:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 20 pid: 14439 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.396561:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 20 pid: 14439 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.396589:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6e30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213d1 expref: 20 pid: 14439 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.396702:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096976.396709:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.396720:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.396728:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096976.396814:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+19:2362:x1877052305299200:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 300us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096976.397366:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790096976.397495:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790096976.397505:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+18:2362:x1877052305299328:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096976.397521:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096976.397528:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.397543:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.397564:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6e1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ca expref: 18 pid: 15854 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.397580:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096976.397585:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.397605:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.397614:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.398178:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790096976.398310:0:14438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.398323:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096976.398366:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790096976.398678:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6e76 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ed expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.398702:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6800/0xcc97d9eae5ab6e7d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213ed expref: 18 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.398711:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:2.0:1790096976.398714:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790096976.398718:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6800, rc 0) 00000100:00100000:0.0:1790096976.398874:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+18:2362:x1877052305299328:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1369us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096976.398884:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790096976.400298:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+17:14489:x1877052305299072:12345-192.168.203.11@tcp:101:dd.0 Request processed in 14806us (15057us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790096976.400311:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1790096976.408470:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.408602:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299584 00000100:00100000:3.0:1790096976.408616:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299584 00000100:00100000:3.0:1790096976.409010:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790096976.409024:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+17:14489:x1877052305299584:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:3.0:1790096976.409408:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.409434:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.409450:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790096976.409516:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790096976.409560:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e52f75 reply state 00000000d73764af transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096976.409570:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790096976.409747:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+20:14489:x1877052305299584:12345-192.168.203.11@tcp:36:dd.0 Request processed in 724us (1290us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790096976.409756:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000020:00080000:3.0:1790096976.409762:0:14439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790096976.413091:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.413465:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299712 00000100:00100000:3.0:1790096976.413482:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299712 00000100:00100000:3.0:1790096976.413587:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1790096976.413601:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+20:14489:x1877052305299712:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790096976.413663:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096976.413691:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e92 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213f4 expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.413802:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213f4 expref: 21 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.413820:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213f4 expref: 21 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.414003:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096976.414006:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096976.414012:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096976.414144:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+21:14489:x1877052305299712:12345-192.168.203.11@tcp:101:dd.0 Request processed in 546us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096976.414152:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00010000:00010000:2.0:1790096976.414292:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414303:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414311:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414318:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096976.414324:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414332:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414356:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:2.0:1790096976.414358:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096976.414363:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096976.414370:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6e8b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096976.437088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096976.437190:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305299968 00000100:00100000:0.0:1790096976.437207:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305299968 00000100:00100000:0.0:1790096976.437294:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790096976.437305:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33f27a14-2671-4c80-af2e-5328abffbff3+20:14489:x1877052305299968:12345-192.168.203.11@tcp:103:dd.0 00010000:00010000:0.0:1790096976.437325:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096976.437365:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6e92 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213f4 expref: 20 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096976.437389:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096976.437396:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096976.437474:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305299968:12345-192.168.203.11@tcp:103:dd.0 Request processed in 170us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096976.437482:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790096976.440710:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096976.440989:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300096 00000100:00100000:1.0:1790096976.441006:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300096 00000100:00100000:1.0:1790096976.441088:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790096976.441100:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305300096:12345-192.168.203.11@tcp:58:dd.0 00010000:00010000:1.0:1790096976.441256:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096976.441307:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096976.441324:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096976.442507:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790096976.443261:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790096976.443354:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790096976.443566:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305300096:12345-192.168.203.11@tcp:58:dd.0 Request processed in 2461us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096976.443590:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1790096976.446343:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096976.446512:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300224 00000100:00100000:3.0:1790096976.446527:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300224 00000100:00100000:3.0:1790096976.446699:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1790096976.446712:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305300224:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790096976.446949:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096976.446984:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b38213fb expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447068:0:15854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447080:0:15854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 20 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447126:0:15854:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447144:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 20 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447161:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096976.447164:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096976.447168:0:15854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 20 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096976.447176:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7400, rc 0) 00000100:00100000:3.0:1790096976.447259:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+20:14489:x1877052305300224:12345-192.168.203.11@tcp:101:dd.0 Request processed in 550us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096976.447267:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00010000:00010000:1.0:1790096976.765321:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790096977.213268:0:14471:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790096977.213280:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790096977.213323:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790096977.213336:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790096977.213515:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee586d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14471:1877052324160768:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790096977.214079:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2cfe840 going to sleep for 11 seconds 00000100:00100000:2.0:1790096977.233131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.233291:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300352 00000100:00100000:0.0:1790096977.233305:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300352 00000100:00100000:0.0:1790096977.233419:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790096977.233434:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305300352:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790096977.233546:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305300352:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 115us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.233554:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790096977.233860:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee586d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14471:1877052324160768:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1790096977.234121:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790096977.236700:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.236819:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300480 00000100:00100000:3.0:1790096977.236831:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300480 00000100:00100000:3.0:1790096977.236904:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1790096977.236915:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305300480:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790096977.236955:0:14439:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790096977.237088:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305300480:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 175us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.237096:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790096977.244144:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.244357:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300608 00000100:00100000:0.0:1790096977.244371:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300608 00000100:00100000:0.0:1790096977.244460:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790096977.244474:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305300608:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790096977.244580:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244603:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244618:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244688:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244696:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244704:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244734:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244774:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244783:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790096977.244837:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790096977.244843:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790096977.244866:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244881:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244888:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244896:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244904:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096977.244909:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244918:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244934:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7f00) 00010000:00010000:0.0:1790096977.244938:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096977.244946:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244964:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6ea7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244982:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244989:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.244995:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245000:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096977.245003:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245008:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245015:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096977.245018:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096977.245021:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245026:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6eae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245044:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245050:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245062:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245067:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1790096977.245070:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245077:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245085:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:0.0:1790096977.245088:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790096977.245091:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.245096:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6eb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.245430:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305300608:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 955us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.245450:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:2.0:1790096977.250269:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.250398:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300864 00000100:00100000:3.0:1790096977.250412:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300864 00000100:00100000:3.0:1790096977.250535:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1790096977.250565:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305300864:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.250605:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096977.250666:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821402 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.250809:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.250829:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.250845:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790096977.250860:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790096977.250996:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251004:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251011:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251018:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096977.251023:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251032:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251046:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096977.251055:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790096977.251063:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251070:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6ec3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251128:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ebc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821402 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251139:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eaac4db7f00) 00010000:00010000:3.0:1790096977.251142:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790096977.251145:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821402 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.251156:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096977.251241:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305300864:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 678us (986us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1790096977.251249:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790096977.253885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.254054:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305300992 00000100:00100000:3.0:1790096977.254066:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305300992 00000100:00100000:3.0:1790096977.254134:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790096977.254145:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305300992:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790096977.254191:0:15854:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790096977.254366:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305300992:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 222us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.254374:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790096977.267340:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096977.267468:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305301248 00000100:00100000:1.0:1790096977.267481:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305301248 00000100:00100000:1.0:1790096977.267589:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1790096977.267602:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+21:14491:x1877052305301248:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790096977.267630:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790096977.267814:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ec00/0xcc97d9eae5ab6ed1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821409 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790096977.271034:0:14437:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1790096977.271052:0:14437:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790096977.271297:0:14437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1790096977.273364:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6ed8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.273394:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.273410:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.273527:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148ec00/0xcc97d9eae5ab6ed1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821409 expref: 24 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.273553:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821409 expref: 23 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.273563:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:0.0:1790096977.273567:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790096977.273571:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9c240d200, rc 0) 00000100:00100000:0.0:1790096977.274424:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+23:14491:x1877052305301248:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 6817us (7093us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1790096977.274450:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1790096977.277596:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790096977.277627:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324160896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790096977.277760:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096977.277906:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324160896 00000100:00100000:2.0:1790096977.277917:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324160896 00000100:00100000:2.0:1790096977.278006:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790096977.278020:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324160896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790096977.278070:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790096977.278143:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324160896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096977.278171:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790096977.278235:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324160896:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790096977.281516:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790096977.284052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.284324:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305301504 00000100:00100000:3.0:1790096977.284356:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305301504 00000100:00100000:3.0:1790096977.284434:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790096977.284456:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+23:14491:x1877052305301504:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.284544:0:15854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096977.284581:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d200/0xcc97d9eae5ab6ed8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821409 expref: 23 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.284607:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac3cb7d00) 00010000:00010000:3.0:1790096977.284624:0:15854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790096977.284862:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.284881:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.284894:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285060:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285085:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285098:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285344:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285354:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285370:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285377:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096977.285382:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285390:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285404:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eaac2c3c700) 00010000:00010000:3.0:1790096977.285407:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096977.285411:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285418:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6ee6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285431:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285438:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285443:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285462:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096977.285465:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285481:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285490:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1b29428c (ffff9eaac2c3c500) 00010000:00010000:3.0:1790096977.285493:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096977.285496:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.285502:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6eed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1b29428c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.286696:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+22:14491:x1877052305301504:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 2233us (2649us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790096977.286707:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1790096977.289486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.289811:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305301632 00000100:00100000:3.0:1790096977.289829:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305301632 00000100:00100000:3.0:1790096977.289905:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:3.0:1790096977.289917:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+22:14491:x1877052305301632:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.289939:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096977.289964:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6ef4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821410 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290001:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6efb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290016:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6efb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290028:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6efb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290139:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6ef4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821410 expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290158:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6400/0xcc97d9eae5ab6efb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821410 expref: 23 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.290167:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096977.290170:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790096977.290174:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6400, rc 0) 00000100:00100000:3.0:1790096977.290247:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+23:14491:x1877052305301632:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 331us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.290254:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790096977.292841:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.295028:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305301888 00000100:00100000:0.0:1790096977.295050:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305301888 00000100:00100000:0.0:1790096977.295264:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1790096977.295278:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+23:14491:x1877052305301888:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096977.295396:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.295419:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.295446:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790096977.296050:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1790096977.296065:0:14438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 506866428840ns, next at 507866425540ns, rc = 0 00000004:00010000:0.0:1790096977.296204:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf69455e reply state 00000000fa028f05 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.296216:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096977.296364:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+25:14491:x1877052305301888:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1086us (3532us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1790096977.296374:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00010000:00010000:1.0:1790096977.299697:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299742:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299751:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299759:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1790096977.299773:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299782:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299805:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:1.0:1790096977.299808:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790096977.299814:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.299821:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d800/0xcc97d9eae5ab6f02 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096977.303734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.304074:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302016 00000100:00100000:3.0:1790096977.304098:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302016 00000100:00100000:3.0:1790096977.304177:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790096977.304190:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+24:14491:x1877052305302016:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.304225:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096977.304254:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821417 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.304338:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 25 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.304356:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 25 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.304407:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:3.0:1790096977.304411:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790096977.304415:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7000, rc 0) 00000100:00100000:3.0:1790096977.304505:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+25:14491:x1877052305302016:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 318us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.304513:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790096977.309413:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.310661:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302144 00000100:00100000:3.0:1790096977.310677:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302144 00000100:00100000:3.0:1790096977.310778:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790096977.310793:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305302144:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790096977.311297:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33f27a14-2671-4c80-af2e-5328abffbff3+6:2360:x1877052305302144:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 506us (1895us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790096977.311307:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00080000:0.0:1790096977.311955:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790096977.315704:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.315819:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302400 00000100:00100000:3.0:1790096977.315832:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302400 00000100:00100000:3.0:1790096977.315902:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790096977.315914:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+25:14491:x1877052305302400:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790096977.316276:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33f27a14-2671-4c80-af2e-5328abffbff3+26:14491:x1877052305302400:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 362us (588us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1790096977.316284:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1790096977.320462:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.320676:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302656 00000100:00100000:3.0:1790096977.320692:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302656 00000100:00100000:3.0:1790096977.320802:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790096977.320814:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+26:14491:x1877052305302656:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790096977.320998:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+26:14491:x1877052305302656:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 186us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.321007:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1790096977.324501:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096977.324982:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302784 00000100:00100000:2.0:1790096977.324996:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302784 00000100:00100000:2.0:1790096977.325075:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790096977.325087:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+26:14491:x1877052305302784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790096977.325116:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790096977.325144:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840200/0xcc97d9eae5ab6f10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382141e expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325240:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325258:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325272:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790096977.325376:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790096977.325465:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325500:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace840200/0xcc97d9eae5ab6f10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382141e expref: 28 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325539:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382141e expref: 27 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.325548:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096977.325552:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790096977.325556:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaace841c00, rc 0) 00000100:00100000:2.0:1790096977.325871:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+27:14491:x1877052305302784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 784us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096977.325879:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1790096977.328832:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.329004:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305302912 00000100:00100000:3.0:1790096977.329021:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305302912 00000100:00100000:3.0:1790096977.329249:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790096977.329271:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:2363:x1877052305302912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.329295:0:15125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096977.329324:0:15125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b3821425 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790096977.329359:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2b651, blocks: 0x1 00010000:00010000:3.0:1790096977.329389:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1790096977.329395:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096977.329408:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 7 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.329440:0:15125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 7 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.329458:0:15125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf6e00, rc 0) 00000100:00100000:3.0:1790096977.329547:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+7:2363:x1877052305302912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 287us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.329555:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790096977.332595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096977.332696:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303168 00000100:00100000:2.0:1790096977.332709:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303168 00000100:00100000:2.0:1790096977.332788:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790096977.332800:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+27:14491:x1877052305303168:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790096977.332947:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+27:14491:x1877052305303168:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 149us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096977.332956:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:1.0:1790096977.335866:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.336007:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303296 00000100:00100000:0.0:1790096977.336022:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303296 00000100:00100000:0.0:1790096977.336225:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1790096977.336236:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+27:14491:x1877052305303296:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790096977.392143:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33f27a14-2671-4c80-af2e-5328abffbff3+27:14491:x1877052305303296:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 55892us (56275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.392159:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000001:00080000:2.0:1790096977.393114:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1790096977.393128:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790096977.393194:0:5874:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1790096977.393698:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790096977.393725:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324161024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790096977.393812:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096977.394018:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324161024 00000100:00100000:0.0:1790096977.394030:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324161024 00000100:00100000:0.0:1790096977.394107:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790096977.394117:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324161024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790096977.394309:0:15710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790096977.394313:0:15710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790096977.394315:0:15710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790096977.394318:0:15710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790096977 -> 1790096977 00002000:00010000:0.0:1790096977.394320:0:15710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790096977.396142:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafbca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1877052324161024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2020us (2324us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790096977.396156:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790096977.397628:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790096977.397745:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eaaffe99180/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790096977.397760:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324161024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790096977.401965:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.402680:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303424 00000100:00100000:0.0:1790096977.402695:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303424 00000100:00100000:0.0:1790096977.402790:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790096977.402804:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2360:x1877052305303424:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790096977.402955:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2360:x1877052305303424:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 154us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.402964:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790096977.417126:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.417314:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303680 00000100:00100000:0.0:1790096977.417328:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303680 00000100:00100000:0.0:1790096977.417406:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790096977.417419:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+14:14491:x1877052305303680:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790096977.417492:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096977.417529:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaace841c00/0xcc97d9eae5ab6f17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382141e expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.417558:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096977.417564:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790096977.418812:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.418838:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.418851:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790096977.419146:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006496fe26 reply state 0000000023062a05 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.419157:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790096977.419312:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33f27a14-2671-4c80-af2e-5328abffbff3+15:14491:x1877052305303680:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1892us (2194us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790096977.419323:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790096977.423354:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:2.0:1790096977.424193:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424212:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424244:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424252:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096977.424258:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424269:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424290:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096977.424294:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790096977.424300:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.424307:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240d400/0xcc97d9eae5ab6f25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.424392:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303808 00000100:00100000:3.0:1790096977.424412:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303808 00000100:00100000:3.0:1790096977.424537:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790096977.424550:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33f27a14-2671-4c80-af2e-5328abffbff3+7:14491:x1877052305303808:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.424583:0:15710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790096977.424613:0:15710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e1ce8c8b382142c expref: -99 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.424948:0:15710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 8 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.424960:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096977.424965:0:15710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096977.424971:0:15710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.425016:0:15710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 8 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.425032:0:15710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 8 pid: 15125 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.425049:0:15710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15710:1877052324161152:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096977.425174:0:15710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac2ea90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790096977.429581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.430147:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305303936 00000100:00100000:0.0:1790096977.430161:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305303936 00010000:00010000:0.0:1790096977.430220:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 9 pid: 15125 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.430274:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1790096977.430285:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+9:2363:x1877052305303936:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096977.430306:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096977.430336:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 9 pid: 15125 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.430353:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 9 pid: 15125 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.430387:0:14422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096977.430393:0:14422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096977.430402:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.430453:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.430507:0:14422:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.430525:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaffe98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14422:1877052324161280:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790096977.430944:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaae69dad80 going to sleep for 11 seconds 00010000:00010000:3.0:1790096977.431341:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce754a01/0xcc97d9eae5ab6f1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821425 expref: 9 pid: 15125 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.431382:0:15710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15710:1877052324161152:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096977.431419:0:15710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.431432:0:15710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eaaffcf7e00, rc 0) 00000100:00100000:3.0:1790096977.431482:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33f27a14-2671-4c80-af2e-5328abffbff3+8:14491:x1877052305303808:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 6935us (8144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.431492:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790096977.435938:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.436227:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaffe98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14422:1877052324161280:192.168.203.11@tcp:105: 00010000:00010000:0.0:1790096977.436259:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096977.436324:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2363:x1877052305303936:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6039us (6765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.436336:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790096977.439890:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304064 00000100:00100000:3.0:1790096977.439914:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304064 00000100:00100000:2.0:1790096977.440063:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790096977.440075:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2362:x1877052305304064:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790096977.440354:0:15122:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790096977.440359:0:15122:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790096976 00002000:00010000:2.0:1790096977.440361:0:15122:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790096975 00002000:00010000:2.0:1790096977.440363:0:15122:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790096977 -> 1790096976 00002000:00010000:2.0:1790096977.440366:0:15122:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790096977.440470:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33f27a14-2671-4c80-af2e-5328abffbff3+8:2362:x1877052305304064:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 396us (4546us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790096977.440495:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790096977.444270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096977.444343:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304192 00000100:00100000:1.0:1790096977.444356:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304192 00000100:00100000:1.0:1790096977.444428:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790096977.444438:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33f27a14-2671-4c80-af2e-5328abffbff3+8:2361:x1877052305304192:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790096977.444495:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.444522:0:15124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.444532:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790096977.444538:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790096977.444543:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.444587:0:15124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.444613:0:15124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096977.445003:0:15124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15124:1877052324161408:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790096977.445173:0:15124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaac783be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790096977.451093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.451194:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304320 00000100:00100000:3.0:1790096977.451210:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304320 00010000:00010000:3.0:1790096977.451269:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.451322:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790096977.451332:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f27a14-2671-4c80-af2e-5328abffbff3+9:2362:x1877052305304320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790096977.451353:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790096977.451384:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.451402:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 9 pid: 15710 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.451478:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096977.451484:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790096977.451492:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.451504:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.451530:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790096977.451622:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f27a14-2671-4c80-af2e-5328abffbff3+9:2362:x1877052305304320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 290us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.451668:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00010000:00010000:1.0:1790096977.453209:0:15124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bbc09e5/0xcc97d9eae5ab6f2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b382142c expref: 8 pid: 15710 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096977.453237:0:15124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15124:1877052324161408:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790096977.453270:0:15124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453283:0:15124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453290:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453329:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453338:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453347:0:15124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453355:0:15124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096977.453360:0:15124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453387:0:15124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453409:0:15124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.453417:0:15124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096977.453523:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33f27a14-2671-4c80-af2e-5328abffbff3+7:2361:x1877052305304192:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 9085us (9267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096977.453534:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790096977.456323:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.456914:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304576 00000100:00100000:3.0:1790096977.456929:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304576 00000100:00100000:3.0:1790096977.457053:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790096977.457067:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+14:14491:x1877052305304576:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790096977.457184:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457207:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457224:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457583:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457621:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457630:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457844:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.457860:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 15 pid: 14437 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.457877:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1877052324161536:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790096977.457989:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad5662000 going to sleep for 11 seconds 00000100:00100000:3.0:1790096977.461190:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaf3b41880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1877052324161536:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790096977.461233:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096977.462975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.463064:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304704 00000100:00100000:0.0:1790096977.463076:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304704 00010000:00010000:0.0:1790096977.463128:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 16 pid: 14437 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.463186:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790096977.463196:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+16:2361:x1877052305304704:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790096977.463214:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790096977.463222:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 16 pid: 14437 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463260:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 16 pid: 14437 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463288:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7000/0xcc97d9eae5ab6f09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b3821417 expref: 16 pid: 14437 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463308:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:0.0:1790096977.463313:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463325:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463333:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.463368:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790096977.463447:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f27a14-2671-4c80-af2e-5328abffbff3+15:2361:x1877052305304704:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 242us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096977.463456:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:2.0:1790096977.464161:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.464175:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790096977.464448:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1790096977.464906:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1790096977.464967:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1790096977.465080:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1877052324161664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790096977.465465:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096977.465540:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0330540 going to sleep for 11 seconds 00000100:00100000:3.0:1790096977.465820:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324161664 00000100:00100000:3.0:1790096977.465831:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324161664 00000100:00100000:3.0:1790096977.465903:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790096977.465915:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14439:x1877052324161664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790096977.466025:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14439:x1877052324161664:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096977.466034:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790096977.468148:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1877052324161664:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1790096977.468938:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790096977.469036:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1877052324161792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790096977.469099:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096977.469993:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0c81e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790096977.470046:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324161792 00000100:00100000:0.0:1790096977.470076:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324161792 00000100:00100000:0.0:1790096977.470157:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790096977.470169:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14439:x1877052324161792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790096977.470492:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14439:x1877052324161792:12345-0@lo:1000:mdt00_002.0 Request processed in 324us (1390us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790096977.470501:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790096977.470883:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1877052324161792:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790096977.470942:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.470954:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.470981:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.470988:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096977.470992:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471001:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471019:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096977.471023:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096977.471027:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471034:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7200/0xcc97d9eae5ab6f41 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471082:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471088:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471094:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471099:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1790096977.471102:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471119:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471129:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:2.0:1790096977.471131:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790096977.471139:0:14439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471151:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.471161:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.474577:0:14439:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7400/0xcc97d9eae5ab6ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7e1ce8c8b38213fb expref: 18 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096977.474609:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1877052324161920:192.168.203.11@tcp:105: 00000100:00100000:2.0:1790096977.474835:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9eaad0c81000 going to sleep for 11 seconds 00000100:00100000:3.0:1790096977.486758:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1877052324161920:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790096977.486824:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486847:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaac148f000/0xcc97d9eae5ab6e99 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486887:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486901:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486914:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486926:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486932:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486938:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486944:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096977.486960:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486967:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486978:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096977.486988:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790096977.486992:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.486997:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf7e00/0xcc97d9eae5ab6f48 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487007:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487012:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487018:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487022:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1790096977.487025:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487031:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487038:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eaac2c3c200) 00010000:00010000:3.0:1790096977.487041:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790096977.487043:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.487048:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eaaffcf6e00/0xcc97d9eae5ab6f3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790096977.487449:0:14471:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790096977.487459:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096977.487499:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000100:00100000:3.0:1790096977.487517:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaeefd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33f27a14-2671-4c80-af2e-5328abffbff3+18:14491:x1877052305304576:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 30449us (31206us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1790096977.487542:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000020:00080000:3.0:1790096977.487551:0:14439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790096977.488303:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790096977.494315:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.494366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790096977.494479:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305304832 00000100:00100000:2.0:1790096977.494500:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305304832 00000100:00100000:2.0:1790096977.494583:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305088 00000100:00100000:2.0:1790096977.494593:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305088 00000100:00100000:2.0:1790096977.494620:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790096977.494796:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf56df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305304832:12345-192.168.203.11@tcp:49:dd.0 00000100:00100000:2.0:1790096977.495001:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf56df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+19:14489:x1877052305304832:12345-192.168.203.11@tcp:49:dd.0 Request processed in 369us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096977.495033:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790096977.495101:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790096977.495111:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+18:14491:x1877052305305088:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790096977.499438:0:14441:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790096977.499542:0:14441:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1790096977.499606:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499622:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499854:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499865:0:14441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499871:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499877:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.499907:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790096977.500033:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33f27a14-2671-4c80-af2e-5328abffbff3+20:14491:x1877052305305088:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 4920us (5661us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790096977.500043:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000020:00080000:0.0:1790096977.500049:0:14441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790096977.501504:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790096977.501517:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.501528:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240c600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:2.0:1790096977.501533:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.501555:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.501574:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eaac2c3ce00) 00010000:00010000:2.0:1790096977.501577:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790096977.501582:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.501588:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9c240c600/0xcc97d9eae5ab6f4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.501604:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096977.501606:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790096977.501607:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790096977.788983:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790096977.795154:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096977.795212:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096977.795530:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305216 00000100:00100000:1.0:1790096977.795543:0:15128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305216 00000100:00100000:1.0:1790096977.795627:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305344 00000100:00100000:1.0:1790096977.795675:0:15128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305344 00000100:00100000:1.0:1790096977.795700:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790096977.795711:0:15128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33f27a14-2671-4c80-af2e-5328abffbff3+8:2360:x1877052305305216:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:1.0:1790096977.795784:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6ab2b650, atime: 0x6ab2b64f, ctime: 0x6ab2b650, blocks: 0x1 00010000:00010000:1.0:1790096977.795796:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.795836:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1790096977.795842:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096977.795849:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096977.795866:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.801385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096977.805847:0:15129:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790096977.805869:0:15129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1790096977.806207:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305472 00000100:00100000:0.0:1790096977.806231:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305472 00000100:00100000:2.0:1790096977.810172:0:16668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790096977.810199:0:16668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:33f27a14-2671-4c80-af2e-5328abffbff3+10:2360:x1877052305305344:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:2.0:1790096977.810264:0:16668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.810294:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096977.811747:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096977.811777:0:16668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096977.811804:0:16668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096977.918145:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1790096977.918175:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1790096977.918289:0:16668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1790096977.918293:0:16668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1790096976 -> 1790096977 00002000:00010000:3.0:1790096977.918296:0:16668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1790096977.918309:0:16668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918322:0:16668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918330:0:16668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918337:0:16668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096977.918342:0:16668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918351:0:16668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918368:0:16668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918388:0:16668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c71539/0xcc97d9eae5ab6f5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096977.918483:0:16668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:33f27a14-2671-4c80-af2e-5328abffbff3+8:2360:x1877052305305344:12345-192.168.203.11@tcp:4:dd.0 Request processed in 108290us (123264us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790096977.918497:0:16668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790096977.918526:0:16668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1790096977.918538:0:16668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:33f27a14-2671-4c80-af2e-5328abffbff3+7:2360:x1877052305305472:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1790096977.918569:0:16668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918581:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096977.918585:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790096977.918591:0:16668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096977.918602:0:16668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919504:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919530:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919537:0:15128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919542:0:15128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148e800 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096977.919545:0:15128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919553:0:15128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919565:0:15128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.919582:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2f5622/0xcc97d9eae5ab6f56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.919668:0:15128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33f27a14-2671-4c80-af2e-5328abffbff3+7:2360:x1877052305305216:12345-192.168.203.11@tcp:4:dd.0 Request processed in 123957us (124525us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790096977.919676:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000001:00080000:1.0:1790096977.988883:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1790096977.990398:0:16668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1790096977.990405:0:16668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790096977.990419:0:16668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990453:0:16668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990462:0:16668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990470:0:16668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaaffcf7000 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096977.990474:0:16668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990484:0:16668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990502:0:16668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096977.990510:0:16668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cba9f69/0xcc97d9eae5ab6f64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096977.990617:0:16668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:33f27a14-2671-4c80-af2e-5328abffbff3+5:2360:x1877052305305472:12345-192.168.203.11@tcp:4:dd.0 Request processed in 72080us (189244us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790096977.994503:0:16668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1790096977.995555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.000309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096978.003582:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305600 00000100:00100000:0.0:1790096978.003596:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305600 00000100:00100000:2.0:1790096978.003953:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305728 00000100:00100000:2.0:1790096978.003959:0:15130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305728 00000100:00100000:2.0:1790096978.004042:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790096978.004052:0:15130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33f27a14-2671-4c80-af2e-5328abffbff3+6:2360:x1877052305305728:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:2.0:1790096978.004102:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6ab2b651, atime: 0x6ab2b64f, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1790096978.004110:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096978.004126:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1790096978.004131:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096978.004136:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096978.004149:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790096978.004441:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790096978.004463:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:33f27a14-2671-4c80-af2e-5328abffbff3+7:2361:x1877052305305600:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:2.0:1790096978.004479:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096978.004488:0:15129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096978.004491:0:15129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790096978.004495:0:15129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790096978.004505:0:15129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096978.006942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096978.006977:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790096978.007043:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096978.010573:0:15128:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1790096978.013540:0:16668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790096978.016271:0:15128:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1790096978.019172:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305856 00000100:00100000:2.0:1790096978.019185:0:15128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305856 00000100:00100000:2.0:1790096978.019247:0:15128:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790096978.019256:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306112 00000100:00100000:2.0:1790096978.019259:0:15128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306112 00000100:00100000:2.0:1790096978.019274:0:15128:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790096978.019280:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305305984 00000100:00100000:2.0:1790096978.019283:0:15128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305305984 00000100:00100000:0.0:1790096978.019856:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790096978.019869:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:33f27a14-2671-4c80-af2e-5328abffbff3+11:2361:x1877052305305856:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:0.0:1790096978.019903:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.019922:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096978.019927:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096978.019934:0:16670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.019948:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096978.024050:0:16668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1790096978.025774:0:16671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790096978.025792:0:16671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:33f27a14-2671-4c80-af2e-5328abffbff3+12:2361:x1877052305306112:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:1.0:1790096978.025830:0:16671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.025846:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096978.025851:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790096978.025858:0:16671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.025872:0:16671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790096978.084128:0:15130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:0.0:1790096978.084140:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1790096978.084156:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084169:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084178:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084187:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace840600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096978.084191:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084221:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084242:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084250:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000fbba20/0xcc97d9eae5ab6f6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096978.084342:0:15130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33f27a14-2671-4c80-af2e-5328abffbff3+20:2360:x1877052305305728:12345-192.168.203.11@tcp:4:dd.0 Request processed in 80288us (84038us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1790096978.084352:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790096978.084382:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790096978.084393:0:15130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33f27a14-2671-4c80-af2e-5328abffbff3+19:2361:x1877052305305984:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:0.0:1790096978.084419:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084431:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096978.084435:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790096978.084441:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.084452:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790096978.085233:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:2.0:1790096978.150896:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1790096978.151256:0:16670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790096977 00002000:00010000:3.0:1790096978.151260:0:16670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1790096978.151287:0:16670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151298:0:16670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151306:0:16670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151314:0:16670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240d400 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096978.151318:0:16670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151327:0:16670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151348:0:16670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.151355:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc7fcec/0xcc97d9eae5ab6f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096978.151441:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:33f27a14-2671-4c80-af2e-5328abffbff3+13:2361:x1877052305305856:12345-192.168.203.11@tcp:4:dd.0 Request processed in 131570us (144503us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790096978.151450:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00010000:00010000:3.0:1790096978.151746:0:16671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152451:0:16671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152458:0:16671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152465:0:16671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaac148f600 already unused, calling callback (ffffffffc141c900) 00010000:00010000:3.0:1790096978.152469:0:16671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152478:0:16671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152495:0:16671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790096978.152502:0:16671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009615490b/0xcc97d9eae5ab6f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790096978.152555:0:16671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:33f27a14-2671-4c80-af2e-5328abffbff3+11:2361:x1877052305306112:12345-192.168.203.11@tcp:4:dd.0 Request processed in 126768us (145576us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790096978.152575:0:16671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00010000:00010000:0.0:1790096978.152746:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152765:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152772:0:15129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152777:0:15129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eaace841a00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:0.0:1790096978.152780:0:15129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152786:0:15129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152795:0:15129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790096978.152802:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16ece60/0xcc97d9eae5ab6f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790096978.152837:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:33f27a14-2671-4c80-af2e-5328abffbff3+9:2361:x1877052305305600:12345-192.168.203.11@tcp:4:dd.0 Request processed in 148376us (157289us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790096978.152844:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000001:00080000:2.0:1790096978.240035:0:7663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1790096978.240122:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1790096978.240140:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240153:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240162:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240171:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9c240dc00 already unused, calling callback (ffffffffc141c900) 00010000:00010000:1.0:1790096978.240176:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240186:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240204:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790096978.240211:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a6778da/0xcc97d9eae5ab6f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790096978.240312:0:15130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2361:x1877052305305984:12345-192.168.203.11@tcp:4:dd.0 Request processed in 155916us (233262us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790096978.240338:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790096978.601631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.601956:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790096978.602070:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306240 00000100:00100000:0.0:1790096978.602079:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306240 00000100:00100000:0.0:1790096978.602138:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1790096978.602148:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2360:x1877052305306240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096978.602229:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8194b6-07c2-49a7-bf7e-91daaed3f55e+13:2360:x1877052305306240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096978.602237:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:2.0:1790096978.609815:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306368 00000100:00100000:2.0:1790096978.609830:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306368 00000100:00100000:2.0:1790096978.609907:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790096978.609917:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+20:2360:x1877052305306368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096978.610011:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33f27a14-2671-4c80-af2e-5328abffbff3+20:2360:x1877052305306368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 95us (8055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096978.610019:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1790096978.616055:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.616106:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.616142:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.616172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790096978.616232:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306880 00000100:00100000:3.0:1790096978.616239:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306496 00000100:00100000:0.0:1790096978.616239:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306752 00000100:00100000:1.0:1790096978.616247:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306880 00000100:00100000:3.0:1790096978.616257:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306496 00000100:00100000:0.0:1790096978.616257:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306752 00000100:00100000:2.0:1790096978.616330:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052305306624 00000100:00100000:2.0:1790096978.616335:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052305306624 00000100:00100000:0.0:1790096978.616354:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790096978.616388:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790096978.616400:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:2361:x1877052305306624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790096978.616508:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0703d30-934a-4288-bec0-100b2251de1f+6:2361:x1877052305306624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 113us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096978.616515:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00080000:2.0:1790096978.616702:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790096978.616707:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790096978.616824:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790096978.616838:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0703d30-934a-4288-bec0-100b2251de1f+5:2361:x1877052305306880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790096978.616908:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0703d30-934a-4288-bec0-100b2251de1f+5:2361:x1877052305306880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096978.616915:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790096978.624723:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790096978.624738:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2361:x1877052305306496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790096978.624859:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33f27a14-2671-4c80-af2e-5328abffbff3+5:2361:x1877052305306496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 125us (8716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096978.624867:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790096978.637488:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0703d30-934a-4288-bec0-100b2251de1f+5:2361:x1877052305306752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790096978.637606:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0703d30-934a-4288-bec0-100b2251de1f+5:2361:x1877052305306752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21230us (21432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096978.637618:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00080000:3.0:1790096978.642344:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790096978.813500:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790096979.517961:0:14471:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790096979.517976:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790096979.518017:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790096979.518025:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1790096979.837284:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790096979.961593:0:16708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1790096980.349015:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324162432:0@lo:400:kworker.0 00000100:00100000:1.0:1790096980.349111:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096980.349201:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790096980.349209:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324162304:0@lo:400:kworker.0 00000100:00100000:1.0:1790096980.349239:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790096980.349283:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162432 00000100:00100000:1.0:1790096980.349292:0:15854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162432 00000100:00100000:1.0:1790096980.349372:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790096980.349383:0:15854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324162432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096980.349686:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162304 00000100:00100000:2.0:1790096980.349693:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162304 00000100:00100000:2.0:1790096980.349751:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790096980.349760:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaee6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324162304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096980.349834:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324162176:0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.349934:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324162048:0@lo:400:kworker.0 00000100:00100000:2.0:1790096980.350943:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877052324162304:12345-0@lo:400:kworker.0 Request processed in 1178us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096980.350954:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790096980.351001:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790096980.351075:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324162816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790096980.351117:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790096980.351181:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162816 00000100:00100000:2.0:1790096980.351188:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162816 00000100:00100000:2.0:1790096980.351227:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096980.351235:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324162816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790096980.351277:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790096980.351322:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaafb154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877052324162816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096980.351346:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790096980.351388:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1790096980.351394:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eaaffe99180, transno 8589934595 00000100:00100000:3.0:1790096980.351759:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096980.351792:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324162688:0@lo:400:kworker.0 00000100:00100000:3.0:1790096980.351969:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790096980.352141:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162688 00000100:00100000:3.0:1790096980.352147:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162688 00000100:00100000:3.0:1790096980.352194:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790096980.352204:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324162688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790096980.352248:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877052324162688:12345-0@lo:400:kworker.0 Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790096980.352255:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790096980.352275:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096980.352300:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1877052324162688:0@lo:400:kworker.0 00000004:00080000:2.0:1790096980.352380:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1790096980.352416:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaeefd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1877052324162816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790096980.353821:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096980.353889:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9eaaee6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324162560:0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.353932:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790096980.354033:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162560 00000100:00100000:0.0:1790096980.354041:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162560 00000100:00100000:0.0:1790096980.354095:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096980.354104:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.354156:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877052324162560:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096980.354163:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790096980.354214:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1877052324162560:0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.354248:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1877052324162304:0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.354262:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877052324162432:0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.354293:0:15710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162176 00000100:00100000:0.0:1790096980.354297:0:15710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162176 00000100:00100000:0.0:1790096980.354330:0:15710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790096980.354338:0:15710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790096980.354378:0:15710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaf3b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877052324162176:12345-0@lo:400:kworker.0 Request processed in 41us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790096980.354384:0:15710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1790096980.354629:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790096980.354655:0:14432:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790096980.354684:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1877052324162176:0@lo:400:kworker.0 00000100:00100000:2.0:1790096980.356279:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877052324162048 00000100:00100000:2.0:1790096980.356294:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877052324162048 00000100:00100000:2.0:1790096980.356358:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790096980.356368:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9eaaffe41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324162048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790096980.357247:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaffe41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cee436cd-c034-4d15-b596-e9f7d5252125+19:3316:x1877052324162048:12345-0@lo:400:kworker.0 Request processed in 874us (3437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790096980.357260:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790096980.357360:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9eaaee6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cee436cd-c034-4d15-b596-e9f7d5252125:3316:1877052324162048:0@lo:400:kworker.0 00000100:00100000:1.0:1790096980.363008:0:15854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9eaaee6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877052324162432:12345-0@lo:400:kworker.0 Request processed in 13613us (13883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790096980.363030:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1790096980.864839:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29511 lines, 29511 kept, 0 dropped, 0 bad.